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ABSTRACT 
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(5) technv^c^l specifications; (6) administration of test; (7) 
management of test data; (8) results of testing; (9) court action on 
testing; (10) costs of testing; and (11) a description of each 
iistrict's testing program. (PN) 



* Reproductions supplied by EDRS are the best that can be made * 

* from the original document. * 



ERIC 



STUDENT PERFORMANCE ASSESSMENT 
in the 
GREAT CITY SCHOOLS 

1982 



/ • 

By 

Judith Hrul and Michael Casserly 



The Council of the Great City Schools 



\ 



Acknowledgements 



We would like to acknowledge a number of our colleagues who helped in 
variou's ways in producing this r-eport. First of all we would like to thank the 
directors of testing, and research and evaluation whom we interviewed by phone. 
We took enormous amounts of their time, and we are grateful for their efforts, 
in trying to make this report a comprehensive and accurate one. Second, we 
-would like to thank the members of the Council's Research Steering 6ommittee 
who helped conceive of the idea for this report. In particular, we would like 
to acknowledge Floral ine Stevens, the Director of Research and Evaluation in 
the Los Angeles Public Schools, who served as the director of this project. 
Without her helpful guidance, we would- have,.never been able to complete the 
effort. Thirdly, we would like to thank th^ Council's Executive Director, 
Samuel Husk, who must have wondered why the phone bills took a sudden surge duri 
the course of this project. His encouragement was unflagging. And finally, 
we would like to thank Glorious Pierce whose diligence is the reason why this 
report looks as nice as it does. 



Table of Content? 



Introduction ^ 

Standardized- Tests in Use > ^ 3 

Norm . Referenced Tests 3 

Criterion Referenced Tests ^ 3 

' Purposes of Testi ng ^ 

Grade Levels and Skills Tested "10 

Selection of Tests 

Who Is Involved in Selection ' 10 

What 'Criteria for Test Selection Are Used . 13 

How Test Items AVe Developed ,^ 15 

Technical Specifications ^^-^ - ^5 

Administration of Tests , V, 

How Students Are Sampled ]^ 



ERLC 



Training for Test Administration 
Student Preparation for Tests 



16 



How Test Security Is Assured 

Which Students Are Exempted 17 

- • ■ 20 

20 



Management of Test Data . ^ 21 

How Test Data Are Kept ' 21 

How Data Can Analyzed 21 

Student Records and Test Results 21 

How Test Results Are Reported 22 

■ 'Who Is Responsible for Testing Programs 22 

Results of Testing • 23 

Setting Cutoff Scores for Passing Tests 23 

What Requirements Are for Remedial Work 24 

Court Action on Testing 25 

Costs of Testing 25 

Individual District Profiles 26 



List of Tables 



1. Commercially Published Norm-Referenced Tests Used 4 

2. Districts with Norm-Referenced, Criterion Referenced, and . 5 

Minimum Competency Tests 

3. Purposes of Standardized Testing 7 

4. Grades Tested with Minimum Competency Tests 9 

5. Minimum Competency Tests and Graduation Requirements 11 

6. Summary of Test Selection Criteria ' 14 

7. Testing Policies for Special Students ^ 18 




ERIC 



student Performance Assessment 
in the 
Great City Schools 

This survey attempts to describe how student performance is assessed in the 
Great City Schools, and focuses solely on formal testing programs involving aca- 
demic achievement. Our purpose is neither to make judgements about these tests 
or to suggest policy chan-ges, but to provide our member districts with information 
on an issue that absorbs a great deal of money and staff time, and that has moved 
to the forefront in the debate over the qual i ty and equity of the nation's public 
education system. 

Student testing is a complex and volatile subject in its own^right. For 
decades , educators have been involved in often heated discussions over appropriate 
means to measure and report student performance. A central piece in that debate 
has been the need for ways to assess district-wide achievement, so that the public 
could answer such general questions as whether or not their schools were getting 
better. In an era of rising taxes, increasing educational costs, decreasing stu- 
dent enrollments, and declining public confidence in the public schools, district- 
wide tests were seen as one way by which parents and citizens could call the edu- 
cation community 'to account. 

District-wide testing," however, immediately surfaces a wide array of cortiplex 
problems particularly in large urban areas, problems that add to the political dif- 
ficulties in administering tests. Instruments must be selected or designed that 
can measure the achievement of students from'a variety of ethnic, cultural, and 
economic backgrounds who may have varying degrees of English-proficiency or may be 
emotionally or physically handicapped. Standardized instruments also assume a com- 
mon curriculum throughout district schools that often does not exist. 
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In addition to looking at how districts have designed testing programs to 
meet this variety in the students they must serve, this report will take up a ? 
number of other issues; including test management, work with test publishers, 
test administration, test security, test use, data storage, and others. We will 
look- s-p-ecifi call y at the kinds of norm-referenced (NRT) and criterion-referenced 
(CRT) tests used in the schpols, as well as at the status of minimum competency 
tests (MCT). we will also look at how the tests are selected or designed, who is 
involved, and how individuals are trained to administer and interpret them. And 
finally this report will examine the kinds of data bases, ^that have been estab- 
lished in the city schools, how and to whom test data ate reported, and how the 
data are managed. We will also include small sections on student records, reme- 
dial work, promotion and graduatibn requirements, cost, and legal considerations. 

The information for this report was obtained directly from personnel in 
Council -member school districts who have responsibil ity for testing programs, 
and who come from a range of central-office departments. Each of the testing 
directors in the city schools was interviewed at length by Council staff on the 
topics covered in this report. Descriptions of each district's program were sent 
to those who were interviewed and to the Superintendent to assure accuracy. The 
topics for the report were developed by the Council ' s- Research Directors under 
the leadership of their own Steering Committee. A description of each district's 
testing program is found immediately following this narrative. | 

Because of the large number and variety of tests in use in the citie's, this' 
report is limited to NRTs , district and state designed minimum competency tests, 
and CRTs. We have restricted our survey to standardized academic tests in district 
wide use, thereby eliminating tests designed by individual teachers for classroom 
assessment and tests of interest, aptitudes, health, careers/and special education 
diagnosis. / 
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standardized Tests in Use : 

1. Norm-Referenced Achievement Tests (NRTs) . A large number of norm- 
referenced tests are now being used in the Great City School districts, 26 dif- 
ferent tests in all. These tests are standardized, commercially-designed instru- 
ments whose, results are measured against those from other students who have taken 
the exam. Portland is the only Council system that does not use any commercially 
published NRTs on a districT-wi de basis. The most commonly used of the commer- 
cial NRTs is the California Achivement Test (CAT) which is used by 14 districts. 
In a few distrtcts, the CAT is used to the exclusion of other' NRTs, while in 
some districts it is only one of many. The next most commonly u^ed test is the 
Comprehensive Test of Basic Skills (CTBS) which is used in nine districts, and 
the Iowa Test of Basic Skills which is used in four. The instrument that is most 
widely used for pre-kindergarten and kindergarten students is the Metropolitan 
Readiness Test, used in ten districts (see table 1). _:A * j 

2. Criterion-Referenced Achivement Tests (CRTs) . The tests in this cate- 
gory include both minimum competency exams and other CRTs that are used for pur- 
poses other than determining minimum competencies. CRTs are normally standardized 
instruments designed commercially, or by a state or school system, whose results 
are keyed against the material thai students were scheduled to learn. 

All but four of the Council districts; Toledo, Cleveland, Minneapolis, and 
Washington, D.C. have some form of minimum competency tests in place. Toledo and 
Cleveland are now under a state mandate to design such exams, however. Thirteen 
of the remaining 24 districts administer state-designed minimum competency tests. 
This is a significant change from three years ago when only Buffalo, New York City, 
St. Louis, and Dade County were using their state's minimum competency exams. At 
that time, a number of city school districts had designed their own tests ahead of 
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Table 1 

Commercially Published Norm-Referenced Tests Used in the GSC 



Name 



1. California Achievement Test 



CTBS 

ITBS 



4. Test of Achievement and Proficiency 

5. Metropolitan Achievement Tests 
Basic Skills Assessment Program 
Cognitive Abilities Test 



^Districts 
14 
9 
4 

; 3 
2 
2 
2 



Elementary 
Level 

13 

8 

4 



Research Associates Achievement Test 



Secondary 
Level 

10 

8 
1 
3 
2 

. 1 



9. 


Stanford Achievement Test 










10. 


Stanford Test of Academic 


Skills 






3 


11. 


Stanford Diagnostic Math 1 


rest 






1 


12. 


Stanford Diagnostic Reading Test 






- 


lo . 


Stanford Achievement Test 


in Reading 








14. 


Test of Academic Progress 








1 


15. 


Individual Criterion-Referenced Test 








16. 


C.A.T. Non-Verbal Battery 










17. 


CTBS Espanol 




3 3 




1 




Commercially Published Tests Used in Pre-K and K 






18. 


Metropqlitan Readiness Test v 


10 






19. 


Cooperative Prje-School Inventory 


4 






20. 


TOBE 




1 






21. 


Pre-School Inventory 




1 






22. 


Stanford Early Sch. Ach. Test 


2 






23. 


School Readiness Survey 




1 






24. 


Clymer-Barrett Test 




r 






25. 


Metropolitan Pre-Primer 




1 






26. 


Boehm Test of Basic Concepts 
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Commercial ly 



Table 
District- 



District- 



State- 



Commercially 





puD 1 1 sneu 
Nf^T + 


aesigneu 
Ach. Test 


CDT 
+ 


desi gned 
Min. Comp. 


desi 
Min.^'. 


ed 

!P- 


publ i shed Test as 
Min. Comp. Test 


Atlanta .. . . " 


'Yes 


No 




Yes ^ 


Yes 


No 


Baltimore 


Yes 


No 




Yes 


Yes 




No 


Boston 


Yes 


No 




Yes 


Yes 




No 


Buffalo 


Yes 


' No 




No 


Yes 




No 


Chicago 


Yes 


Yes 




Yes* 


No 




No 


Cleveland 


Yes 


No 




'No 


No 




No 


Dade County 


Yes 


No 




No 


Yes 




No 


Dallas 


Yes 


Yes , 




Yes 


Yes 




No 


Denver • 


Yes \ 


Yes 




Yes 


No 




No 


Detroit 


Yes 1 


Yes 




^ Yes 


Yes 




No 


Long Beach 


Yes i 


No 




, No 


No 




■ Yes 


Los Angel es 


Yes 


Yes 




Yes 


No 




No 


Memphis 


Yes 


No 




No 


Yes 




Yes** 


Milwaukee 


Yes 


I No 




No 


No 




Yes 


Minneapol is 


Yes 


Yes 




No 


•Mo 




No 


Nashville 


Yes 


No 




• No 


Yes 




Yes** 


New Orleans 


Yes 


No 




No 


: Yes 




No 


New York City 


Yes 


Yes 




No 


Yes 




No 


Norfolk 


Yes 


, Yes 


Yes (one section) Yes 




No 


Oakland 


Yes 


Yes 




Yes 


No 




No 


Philadelphia 


Yes 


No 




Yes 


No 




No 


Pittsburgh 


Yes 


Yes 




No 


No 




Yes 


Portland 


No 


Yes 




Yes 


No 




No 


St. Louis 


Yes 


. No 




No 


Yes 




No 


San Francisco 


Yes 


No 




Yes 


No 




No 


Seattle 


Yes 


No 




Yes 


No 




No 


Toledo 


Yes 


No 




No 


No 




No 


Washington, D.C. 


Yes 


Yes 




No 


No 




No 




27 


12 




14 


13 




5 



^original ly ^designed by a commercial publisher 

**Current Tennessee Proficiency Test is commercially published. However, the state is 

developing its own test. 
+ The distinction here between NRT's and CRT's is a somewhat artificial one. There are 
commeV-cial ly designed CRT's and district designed NRT's. 
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state-mandates for state-wide tfesting. Lt appears that many of those syst^gms 
have now substituted their own exams for those designed by the state. In the 
Council's 1979 report on minimum competen^cy^terting, we concluded that many state- 
level comp-etency exams had actually originated in some cities, and that the new 
state exams were developed partially as a city-state venture. This^/procesg appears 
to have continued over the ensuing three years. 

.1 Six of the thirteen districts use both state and locally-designed minimum 
competjency tests. Five districts use a commerically-developed instrument as an 
MCT; iticluding Memphis and Nashville which use the state-wide commercial ly- ^ 
designed Tennessee'^Proficiency Test; and Long Beach., Pittsburgh, and Milwaukee 
which chose a commercially-designed test for use as an MCT. Six districts 
use MCTs that were designed in-house: Chicago^ Denver, Los Angeles, Portland, 
San Francisco, and Seattle. The Denver test, or variations of it, have been used 
since 1960. 

In addition to those minimum competency tests, twelve districts ' design their 
own criterion-referenced tests to serve a variety of special i'zed purposes. Only 
two districts, Minneapolis and Washington, D.C. , rely on these CRTs to the exclusion 
of regular minimum competency exams. Toledo and Cleveland are the only dis- 
tricts which rely solely on commercially-designed NRTs to test on a district-vRde 
basis. A total of sixteen districts, then, do not develop their own CRTs for 
district-wide assessment. 

We should note at this point that the distinction between NRTs and CRTs is 
not one that is he,ld by all test specialists. Portland, for instance, makes no 
distinction. There are, in fact , NRTs tha c are 'district or state designed and 
CRTs that are commercially-designed. Tests designed for one purpgse may be used 
or modified for another in order to meet the particular needs of the district. 
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Purposes of Testing : 



Both NRTs and CRTs are used for a variety of purposes in the Great City 
Schools, including: ' program evaluation, placement of students, diagnosis of in- 
dividual sttfdent strengths and weaknesses, remedial class assignment, curriculum 
assessment, student promotion or graduation, assessment of district-wide achieve- 
ment, and determiniation of need for teacher in-service training. The chart below 
indicates the number'of districts that use NRTs an'd CRTs for the specified pur- 
poses. The only district not included in the chart is Portland whose locally- 
designed Rasch-based tests are developed to combine the features of both CRTs and 
NRTs . 



Table 3 



Purposes of Standardized Testing 



Testing Purposes 



Norm-Referenced 
El ementary Secondary 



8 Program Evaluation • 24 

9 Student Placement 18 
8 Student Diagnosis 19 

8 Remedial Class Assignment 17 

9 Curriculum Revision 19 
9 Student Promotion 4 
9 District-wide Achievement Progress 27 
9 Need for Teacher In-Service 9 

Training 



23 

17' 

18 

16 

19 

3 
25 

8 



Criterion-Referenced 
El ementary Secondary 



10 
9 
16 
10 
12 
7 
9 
7 



9 
9 
15 
10 
12 
4 

10 
7 



The most common uses of the^norm referenced tests involve program evaluaj;;^ 
tion' (including federal program assessment), assessment of district-wide achieve- 
ment progress over time, curriculum revision, eTnd student diagnosis for individual 
strengths and weaknesses. Criterion referenced tests are,~'lrs--0Jie^ mi ght expect, 
used mostly to evaluate curriculum and to diagnose students. Test resultwre 
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used to some extent in every district for identifying the need for curriculum re- / 
vision. Most of the systems are able to examine test results at the district, 
regional, school, or classroom level to identify weak spots in -the curriculum or 
in curriculum implementation. When curriculum revision is a major purpose for 
the testing, CRTs would seem to be especially useful because they can be spe- 
cifically designed to match curriculum objectives. 

One of l^he more controversial purposes of tests like CRT minimum competency 
exams .involves their u-^.-^ in . determining student promotion or graduation. Seven 
districts use the results of NRTs to/help in the process of deciding which 
students to promote, and 11 districts use the results of CRTs for the same purpose. 
In almost all cases, the test results are only one factor, amongst many, in the- 
decision making process. 

Minimum competency exams are also requirements for high school graduation in 
twelve districts and will become mandatory for graduation in five others in three 
years. Three years ago only six Council dis^tricts used those exams as a graduation 
requirement. Obviously, the trend is toward greater use of test results to deter- • 
mine eligibility for graduation. In most of the districts with this requirement, 
students not passing the exams do not or will not reo§'ive diplomas. They will, 
instead, receive certificates of performance or attendance, lower grade diplomas, 
letters of candidacy for graduation', or other similar forms of recognition. In 
Detroit, for instance, those notpassing the exams reci eve"uhendorsed" diplomas. 
In^ l^tsburgh , students who do not pass the exam are placed in a remedial course 
which they must pass to graduate. In addition, most districts with the graduation 
requirement begin giving students theMCTs as early as the 9th or 10th grade (see 
table 5). 



Table 4 

. Grades Tested With Minimum Competency Exams 



Atlanta 
Baltimore 

Boston 

Buffalo 
Chicago 

Dade County 

Dallas 

Denver 

Detroit ' 

Long Beach' 

Los Angeles 

Memphis 

Milwaukee 

Nashville 

New Orleans 

New York City 
Norfolk 

Oakland 

Philadelphia " 
Pittsburgh 

Portland 
St. Louis 

San Francisco 
Seattle 



El ^mentary 
K-8 



1-8 

2, 5, 8 

3, 6, 8 
8 

3, 5, 8 

8 (or until 
passing 

4, 7, 8 
8 



Secondary 
9-12' 



Test 
Producers 



Variables 
Tested 



10 (or passing) State 



9 (or until 
passi ng) 

or until passing 

9, 11 or 12 
^ or until passing 



10 (or until 
passing) 

.-9 (or*- until 
passing) 

9 (or until 
passing) 

10 (or until 
passing) 

or until passing 



State and 
District 

State and 
District 

State 

Di strict 



Statue 

State and 
Di strict 



Reading, Math, Problem 
Solving 

Reading, Math, Writing 

Reading, Writing, Math 

Reading, Writing, Math 

Language Arts, Computation 
and Problem Solving, 
Life Skills 

Reading, Writing, l^aTH", 
Communications Skills 

Cuts across all subject 
areas— life skills 



District Math, Reading, Laaguage" 



1-7 10 (or until 

passing) 

9 (or until 
passing) 

8 9 (or until 

passing) 

9 (or until 
passing) 

2, 3, 7 10 (or until 

passing) 

3, 6, 8 9, 11 or 12 

10 (or until 
passing) 

3, 5, 7 9 (or until 

passing) 

10 or until passing 

- '10 or until passing 

8 or until passing 

8 or until passing 



3, 5, 8 9 (or until 

passing) 

3, 6 9 (or until 

passing) 



State and 
District 

CTB McGraw- 
Hill 

District 



State 

ETS Addi son- 
Wesley 

State 
State 

State 

State and 
District 

District 

District 

ETS Addi son- 
Wesley 

'District 
State 

District 
District 



Reading, Writing, Math 

Reading, Language, Spelling 
Math 

Reading, Computation, 
Writing 

Math, Reading, Language, 
Spelling 

Math, Language Skills, 
Reading, Writing (District) 

Math-, Reading, Language, 
Spelling 

Writing, Language Arts, 
Reading, Math ^ 

Reading, Writing, Math 

. Reading, Math, Social 
Studies 

^Reading, Math, Language 

Reading, Mathematics 
Readying, Math 

Reading, Math, Language' 
Usage 

Reading, Language, Math, 
Government/Economics and 
others 

Reading-, WriTi ng ,-Math 

English, Reading, Math, 
Language, Life Skills 



Grade Levels and Skills Tested : 

There appears to be a great deal of consistency in the areas tested with 
both MCTs and NRTs. The focus of the MCTs is on the basic skill s— reading, 
writing. Mathematics and lapguage arts. Twenty three of the districts assess 
either reading. Mathematics or both, 10 assess minimum writing skills, 12 examine 
language arts or communication skills, and three assess spelling abilities. The 
extent to which the tests focus on so-called "survival skills" was not determined; 
■however, three districts sped f real ly mentioned the assessment of "life skills". 
A small number of districts also assess such areas as Social Studies, Government 
and Economics, and Career Awareness. These MCTs are, for the most part, focused 
on the secondary grades, with testing beginning in grades 9 or 10 and continued ^ 
until passing. Twelve of the districts, however, have MCTs which also concen- 
trate on the basic skills for elementary grades. 

The focuf of both NRTs and criterion-referenced tests (other than competency 
tests) also appears to be upon basic reading, writing and arithmetic skills. 
There seems to be a greater tendency, however, to use the NRTs in the elementary 
grades since the results are 'Often used for diagnostic or placement purposes. 

i 

Selection of Tests : -^^ • j 

1. Who Is Involved in Selection . This survey found e>ctre'mely wide variation 
in who was involved in selecting commercially-published exams Vnd in developing 

I 

district tests. We found that nine districts have standing te^t review or develop- 
ment committees. In the other districts, ad_ hoc committees a/re formed when it is 
necessary to choose or design a new test. Seventeen of the districts mentioned 
specifically that research and evaluation personnel were involved in the review 
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Table b . 
Minimum Competency Tests 





State-designed 


Graduation Req. 


District-designed 


Graduation Re< 


Atlanta 


Yes 


Class of 1985 


Yes 


Class of 1985 


Baltimore 


Yes 


Class of 1982 


Yes 


Yes 


Boston 


Yes 


No 


Yes 


No 


Buffalo 


Yes 


Class of 1982 


No 





Chicago 


No 





Yes 


Yes 


Cleveland 


No 





No 





Dade County 


Yes 


No 


No 





Dallas 


Yes 


No 


Yes 


Class of 1983 


Denver 


No 


— «- 


Yes 


Yes 


Detroit 


No 




Yes 


Qua! if ied 


Long Beach 


No 




Yes 


: ' Yes 


Los Angeles 


No 


_ _ ^ 


Yes 


Yes 


Memphi s 


Yes 


Class of 1984 


No 


No 


Milwaukee 


No 





Yes 


Yes 


Minneapolis 


No 





No 


— 


Nashvil le 


Yes 


Class of 1984 


No 


— 


New Orleans 


Yes 


No 


No 


— 


New York City • 


Yes 


Class of 1982 


No 


— 


Norfolk 


Yes 


Yes 


Yes 


Yes 


Oakland 


No 





Yes 


Yes 


Philadelphia 


No 


^ 


Yes 


Yes 


Pittsburgh 


No 




Yes 




Portl and 


No 




Yes 


Class of 1984 


St. Louis 


Yes 


No 


No 




San Francisco 


No 


No 


Yes 


Yes 


Seattle 


No 




Yes 


No 


Toledo 


No 




No 




Washington, D.C. 






No 





and/or development process, and thirteen indicated specifically that their testing 
specialists were part of the process. In addition, thirteen districts indicated 
that their curricul um..,.and personnel were involved. Eight other districts mentioned 
the involvement of "academic supervisors"or "instructional consul tants" , which im- 
plies that there is widespread participation by curriculum-related central office 
staff. 

The involvement of personnel outside the central offi^ce did not appear as 
wide-spread, with the exception of teachers. Eight/een districts indicated that 
teachers vera actively involved. Only eleven districts mentioned that counselors 
were y\)utinely involved, and only eight indicated the active involvement of 
principalis. Two other districts, however, cited the involvement of buil^ding level 
staff , without specifyi ng exactly who they were. 

The participation of parents appears to be the weakest component in the 
selection or development process. Only five districts specifically mentioned 
parents being involved in the test selection process, an^d only four others men- 
tioned some form of community involvement. In these four districts, parents may, 
in fact, be acting as community representatives. We found only one district that 
mentioned spedifically that it involved students or student representatives in . 
the test selection or development process'. In summary, then, it appears that al- 
most all districts use either a standing committee or ad hoc committee process 
in test specification, and that the majority of committee members are normally 
found in the central offices of the districts. 

2. What Criteria for Test Selection Are Used . The criteria for the selec-^ 
tion of standardized tests also vary a great deal. Only seven of the 28 districts 
indicated that they use pre-set criteria, ratings, or review forms in test selec- 
tion. Nashville and. Los Angeles have indicated, however, that such formal criteria 



are under development. Mc5t of the districts stressed that criteria such as 
>'match-of-test to the ^curricul urn'' , Vepresentativesness of norming population", 
validity, reliability, and racial or gender bias considerai tons were used most 
often, whether orAnot formal procedures had been drawn up. A list of sample cri- 
teria we found as ^rt of this survey is found in table 6. 

We also found that very few districts have any formal policies for dealing , 
with test publishers. Thirteen districts stated simply that published are . 
routinely invited to make presentations to test selection committers, and nine 
others indicated that specimen-tests from publishers are periodical\^eviewed 
even when the publishers themselves are not involved.* New York and Detroit are 
the only districts 'that use a formal bidding process when purchasing tests from 
commercial publishers. New York has a formal process that includes issuing RFPs 
with technical speci;f ications and a pre-bidder's conference. State law in Texas 
requires bids to be/submitted in Dallas, but the selection process usually yields 
a sole bid. New leans oft^n requests bids, and Dade County indicates that it 
conducts negotiations. Most districts , however, stated that price considerations 
were only one factor or not a factor at all in test selection. 

Our survey also found that only five of the districts reported conducting 

\ , ' ■ ■ 

\ _ - ' 

pilot tests prior to the final selection o\f new exams. In Chicago, the publishers 
of tests under consideration are asked to \ay for the costs of these pilot tests, 
and two other districts specified that tests were piloted after. final decision but 
before full district implementation. 

• ' 3 How Test Item s Are Developed . The Council^ districts appear to use two 

■ \ 

procedures for developing individual items for their own tests. These tests can 
be either criterion or norm-referenced. Most districts rely .primarily on teachers 
and curriculum personnel to write items, and research/testing personnel to test the 
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Table 6 Summary of Test. Se1 ection Criteria 



Descriptive Criteria 

0 Relationship to curriculum 

0 Availability of alternate forms 

0 Ran^e of grades available 

0 Grade continuity 

0 Short practice tests available 



Technical Criteria 

0 Content validity 

0 Construct val idi ty 

0 Concurrent val idity 

0 Predictive val idity 

0 Reliability 

0 Internal consistency 

0 Freedom from racial and gender bias 



Test Administration 

. 0 Training required to administer 

0 Clarity of instructions 

0 Ability to sustain student interest 

0 Ease of recording answers 



Test Results 

0 Scor^/ig^^ase 
\ 0 Existing data bank 



\ 



0 Format 

0 Comprehensiveness 

0 Range of performance available 

0 Length 

0 Durability of test booklets 



0 norming population 
0 Sequencing of items 
0 Sufficient items to measure skills 
0 Appropriateness for placement 

and testing 
0 Ease of implementation for 
functional level testing 



0 Administrative usability 
0 Adequate manual 
0 Time required 



0 Types of scores provided 



Cost' of Tests 
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items' technical specifications. In some cases, the districts may use item banks 
or pools set up by test publishers or by regional labs. Portland and Seattle, 
for instance, occasionally use an item po'ol developed by the Norijhwest Evaluation 
Association, Oakland sometimes uses the NIE National Education Assessment pool, 
and occasionally uses test publ ishers existing item banks for which a royalty must 
be paid, and Atlanta may draw from the Atlanta Assessment Project pool. 

Technical Specifications : 

ThisTurvey found that nearly all- districts use some criterion for assuring 
test validity. For the most part, the districts assume content validity for the 
tests that they develop and key to the curriculum. As we indicated "Before, many 
of the district-designed tests are developed to assess curriculum strengths and 
weaknesses, and that curriculum and. subject matter -special ists are involved in 
preparing test itew^.that are related to curriculum objectives. The assumption 
is made that thi p^cess of test development is an assurance of content-valid 
items. We found only one district, Portland, that uses a type of criterion valid- 
ity to assess its instruments. Again, Portland uses' a mix of both norm and cri- 
terion referencing in its test development. 

All districts that develop their own tests use a variety of procedures for 
assuring the reliability of the exams. We found that this process is a continu- 
ous one in the sense that the districts conduct reliability studies on a fairly 
regular basis. In addition, the districts appear to use a two-step process when 
designing their own tests to assure that racial , cultural and gender bias has 



been excluded. The first step is normally at the item-design phase; when each 
item is written, it is reviewed for bias by test committee members consisting of 
male and female members of various ethnic backgrounds. The second step involves 
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detailed item analyses for each racial or gender grouping when the exams are 
pilot tested. 'Not all districts, however, use. both steps. 

In Cleveland, where the school district does not design its own tests, one 
"-commercially-published exam will be tested for bias using a Logist Test procedure. 
In Detroit, the district has had publishers change items when bias was detected. 

Administration of Tests: 

■ ' ^ A 

1. How Students Are Sam'pled . With few exceptions, we found in this survej/ 
that all students in all designated grades are given standardized norm-referenced 
or criterion-referenced tests. No sampling p^lans are generally used when tests- 
are administered. The exceptions are found in the California cities and in Milwaukee. 

/in Cal ifornia , one state test is administered using a matrix sampling procedure, 
and in Milwaukee, students are serially sampled for grade 12 testing. The only 
other exceptions occur with the periodic testing for special education classroom 
placernent. 

2. How Test Security Is Assured . The extent to which the Great City 
Schools take steps to' assure the security of their tests also varices. The most, 
common procedure involves storing the tests in central offices or wareho/uses. 
These tests are generally sent to the schools just prior to test adminlistration 

• and returned immediately .a-'fterwards . Some type of inventory process Is usually 
established to count testfs before and after administratio^n. 

..Once tests are in the schools, their security normally becomes the responsi- 
•bility of principals, counselors, or designated building test coordinators. 
Baltimore and Dallas mentioned that random sample observation is conducted during 
test administration, and in Minneapolis, school counselors monitor the test-giving 
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process. In New York, the Inspector General's office often observes test security 
measures in schpols and will either recommend punative measures or demand the use 
of alternative forms if violations are found. 

3. Which Students Are Exempted . The trend in the Great City schools 
appears to be to test all students who are able to be tested or who may benefit 
from testing. This trend applies to norm-referenced tests, criterion-referneced 
tests, and minimum competency tests. The exceptions involve special education 
students and limited-English-proficient students. Most districts have or are 
taking steps to accommodate students with various physical handicaps'. Large 
print and Braille versions of ;tests are now available in most districts, and 
orthopedicaTly handicapped students normally are administered tests in special 

» ■ 

individual sessions if' academic testing is warranted. | 

Also, most districts require students to take and pass minimum competency 
exams in English, ever when passage/is a graduation requirement. LEP students are 
excused in Boston on an individual basis, whil e , exemption in Seattle and Milwaukee 
is a function of a student's English language proficiency. Both Milwaukee and 
Detroit will exempt foreign born students who have been in the country for less 
than a specified time. New York and Buffalo now give their state's Math minimum 
competency exams which has J)een translated into 22 languages, and New York City 
has a procedure to allow writing samples to be taken in a student's native lan- 
guage. Portland is the only other district we know of that is currently planning 
to translate its Math tests into different languages. 

The only other exemptions we identified were in New York, Buffalo, and 
Boston. In the first two, students with high scores on CEEBs and ACTs are exempt 
from the state minimum competency tests, and students in Boston who entered the 
system after grade ten are al so 'exempt from state-wide tests. 



Table 7 

Policies for Special Students 



School 
System 

Atlanta 

Baltimore 

Boston 

Buffalo 

Chicago 

Dade County 

Dallas 

Denver 

Detroit 

Long Beach 
Los Angeles 
Memphis 



Mentally 
Handicapped 
Students 

-exempt from tests 

level three & above 
students exempt 

must meet lEP 
standards 



alternative testing 
methods 



must take tests for 
diagnosi s if lEP 
specifies 

EMR, TMR, PMR exempt 
unless parents request 

students w/special 
education class exempt 

not required to take 
test unless di ploma 
desired 



optional 



must meet lEP stan- 
dards 

must meet lEP stan- 
dards 

'exempt unless student 
requests 



Adaptations 
for Physical ly 
Handicapped 
Students 

large print 
none 

must meet lEP 
standards 

adaptations made 
on individual 
basi s 

must follow lEP 



Braille, large 
print, other 
adaptations 

no policy 



no pol icy 



Braille,^ large 
print, oral ad- 
min^nstration 

a/aptations for 
b/lind and hard 



of .hearing 

/large print, 

/ oral adminis- 
/ trati on 

large print, 
special accom- 
mobations for 
orthopedical ly 
handicapped 



NEP/LEP 
Students 

must take tests 
i n Engl i sh 

must pass tests 
in English 

determined on 
i ndi vidual 
basis 

Math in 22 
1 anguages 

must pass tests 
in English 

must pass in 
Engl i sh 

tests must be 
passed in 
English 

must pass tests 
in English 

NEP/LEP in 
country less 
than one year 
exempt 

must pass tests 
in English 

must pass tests 
in English 

must pass tests 
in English 



Other 
Students 



no O'th^r students , 
exempt 

no other students 
exempt 

students entering 
system after grade 
10 exempt 

High scores on 
CEEB and ACT exempt 

no other students 
exempt 

some emotionally 
handicapped exempt 

•^nq other students 
exempt 

no other students 
exempt 

no other students 
exempt 



no other students 
exempt ' 

no other students 
exempt 

no other students 
exempt 



(cont'd) 
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School 
System 

Milwaukee 



Nashville 



New Orleans 
New York City 

Norfol k 
Oakl and 
Philadel phia 

Portl and 

St. Louis 
Seattle 

San Francisco 



Mentally 
Handicapped 
Students 

TMR, EMR, LD exempt 
from tests 



exempt unless stu- 
dent requests 



must meet lEP 
standards 

alternative testing 
methods 



special provisions 
made 

mtjst meet lEP stan- 
dards 

those in self- 
contained classes ex- 
empt 



any student who carl 
take tests under noV- 
mal con'ditions 

must meet lEP 
standards 

exemption depends on 
teacher judegment 



• Adaptations 
for Physical ly 
Handacapped 
Students ' 



none 



large print, 
special accom- 
modations for 
orthopedical ly 
handicapped 

no pol icy 

adaptations 
made individual 
ba s i s 



large print, 
some individual 

individual de- 
termination 

teacher dis- 
cretion on means 
of administra- 
tion 

being planned 



must meet lEP 
standards 

Braille, large 
print, taped 
tests 

adaptations made 



NEP/LEP 
Students 

as wel 1 as 
those iden- 
tified as LEP 
under set 
procedures 
described by 
law 



Other 
Students 



no other students 
exempt 



must pass 
English 



in 



exempt upon 
request 

Math in .22 lan- 
guages, writing 
in native lan- 
guage 

must pa-?s in 
Engl ish' 

must pass test 
in Engl ish 

must pass read- 
ing tests in 
Engl ish. Math 
available in 
Spanish 

Math being de- 
veloped in other 
1 anguages 

no policy no other students 

exempt- 
exemption func- no other students 
tion of oral exempt 
proficiency score 



no other students 
exempt 



no other students, 
exempt 

high scores on CEEB 
and ACT exempt 



no other students 
exempt 

no other students 
exempt 

no other students 
exempt 



must pass tests 
in English 



no other students 
exempt 



EMR-Educab^e Mentally Regarded; TMR-Trainable Mentally Retarded; PMR-Profoundly Mentally Re- 
tarded; LD-Learning Disabled 



-19- 



ERIC 



\ / • •• , 

4/ Training for Test Administration . All districts in this survey appeared 

aware pf the need for faculty/administrator training in test administration-. The 
extent to which such training occurs, however, seems to' be a' function of staff 
time^'and resources, which are usually in short supply in the cities. Fifteen of 
the districts indicated that in-servicA^training of test administrators wa5 pro- 
vided by central district personnel .:'- rrijii.ost cases, central office staff conduct 
workshops for designated building test coordinators who, in turn, are responsible 
for faculty training. In other districts, training is the responsibility of 
counselors or test coordinators. The frequency of the training also varie's. In 
several districts, training occurs annually but may be attended only by new tea- 
■ chers. Training occurs in other districts only when new tests are introduced, 
: when a request is made, or staff is available for such sessions. 

5. Student Preparation for Tests . Almost all of the Council's districts in- 
dicated that students are not routinely prepped to take standardized tests. 
Cleveland, Oakland, and St. Louis are the only districts that indicated that indi- 
vidual schools run voluntary, supplemental programs outside of regular classroom 
work to prepare students for tests. St. Louis, however, actively discourages the 
procedure. Seattle is now field-testing the Random House Program, "Scoring High 
on the CAT", making that district the only one we know of that is making such an 
effort. Dallas and Washington, D.C. prepare students on how to. take tests but not 
for specific exams. The Dallas Testing and Information staff have prepared a skit 
which they perform in schools and at PTA meetings on how to take tests, and tea- 
chers in Washington have written a handbook called "Moving Up to Success in Test- 
Taking" for use in the classroom. 
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Management of Test Data : 

1- How Test Data Are Kept ; Most districts, 18 In aTl , maintain separ*ate"^ 
test data and student record files, although several districts have the capacity 
to merge 'fTles via student I.D. numbers. In only four districts, the student and 
test data bases are identical, that is, all test data are recorded on student 
records. Two districts maintain both a student data base with test information 
and a separate test data base. Two other districts indicated that current-year 
test results are recorded on the student data base, but that each year's entry 
automatically deletes the previous entry. Only two districts indicated that no 
formal test data base is maintained. Fifteen districts, in all, specified that 
their data base consisted only of results from NRTs ; in three districts only 
CRT data are kept; and in all others, both types of data are recorded. 

2. How Data Can Be Analyzed . Because testing is done on a district-wide 
basis, all districts are capable of analyzing test results at that level, and 
almost all are capable- of producing test results by school. Nineteen districts 
either generate analyses by gender or have the capacity to do so, seventeen can 
analyze data by race, eight by language or language status, and three districts 
reported the capacity to analyze dat.a i ndirectly by SES. In addition, twenty one 
districts reported that longitudinal test data are maintained, but twelve of them 
noted that such data could be obtained only by accessing individual student re- 
sults. Only three of the districts reported that they do not keep longitudinal 
data . . . 

3. Student Records and Test Results . We found in this survey that only 
one district does not record test information on student records. In all other 
districts, notations of some nature are made regarding the results of NRT or CRT - 
exams. Generally, school administrative personnel, principals% teachers, 



counselors, and parents have access to these records. Ten districts permit stu- 
dent access to individual files by request, or appointment; but in four districts, 
students must have reached the age of majority before they are given access to 
their records. 

4. How Test Results Are Reported . In addition to internal reports, most 
districts release information on. test scores directly to the public or indirectly 
through the Board of Education., 

We also found that almost every district makes an effort to assure that 
teachers receive assistance with the interpretation of test results. The pri- 
mary mechinisms for this purpose are in-service workshops, programs or staff 
meetings in 18 districts. Ten districts reported that they provide written as- 
sistance which, in some cases, is in addition to workshops, and in others the 
primary mechanism. Three districts responded that the type of assistance gj-ven-" 
faculty is a local school option. 

Seventeen school districts send parents written reports which, in addition 
* to test results, contain information designed to assist with interpretation and 
understanding of the results. Assistance is also offer|Sd in 13 districts at 
parent-teacher conferences while six districts work with various parent groups. 
Portland and San Francisco have manuals/brochures for parents and St. Louis is^ 
in the process of preparing one. Four districts responded that assistance with 
test result-interpretation for parents is a local school option while three dis- 
tricts send no test results home. 

5. Who Is Responsible for Testing Programs . In 25 of the districts, the 
departments that have the responsiblUy for research and evaluation are inde- 
pendent organizationally from departments having responsibility for curriculum 
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and instruction. Responsibility for test administration is currently located 
in departments of research and evaluation in 19 of these districts. In five ' 
districts, curriculum and instruction divisions or testing offices within 
these divisions have responsibility for test administration. In Chicago, re- 
sponsibility is split between Research and Evaluation (NRTs and Proficiency 
exams) and Curriculum (CRTs). In three districts, the research and evaluation 
functions of the system. fall under a division of curricul um Tor the purposes 
of testing. 

Results of Testing : 

1. Setting Cutoff Scores for Passing Tests . In the districts that cur- 
rently administer competency exams and for which passage is relevant, there is 
great variance in how cutoff scores were determined. ' No two districts jused 
exactly the'' same procedures. In seven districts, central office administrative 
personnel were solely responsible. In eight districts, school level personnel 
(primarily teachers) were involved in the process in addition to central office 
personnel. In six of these eight districts, community members and/or parents 
were also involved. 

.....Very littl^ information regarding standards was provided to us. In Portland, 
the standard-a'dopted by the Board of Education is a 9th grade national equivalent, 
and Baltimore has a presumption of 9th grade functional skills,.. In St. Louis, 
which uses a state-designed minimum competency test, the standard is based on ma-, 
terials which should have been presented by 6th or 7th grade. 

Because of the diversity of tests used for minimum competency, no general- 
izations can be made regardJW cutoff scores. Although Pittsburgh and Milwaukee 
uses the same commercjifly published norm-referenced test as a minimum competency 



test, each used different procedures to determine cutoff scores and have dif- 
ferent baseline figures. In those districts which administer state-designed' 
minimum competency tests, standards and cutoff scores were set by the state. 
Boston, which sets its own, subject to state approval, is the only exception. 

Comparable data on competency test rates were impossible to obtain. Some 
districts tests are still in the process of modification or early implementation 
and no figures are available. In other districts, pass rates -for all grades 
tested were averaged. It appears, however, that on repeated testing that nearly 
all students pass the MCTs by the end of their twelth grade year. 

2. What Requirements Are for Remedial Work . The retaking of tests , however , 
is not necessarily the main reason for such high passing rates by the twelfth 
grade. Twenty districts have policies for mandatory remedial work when students 
fail tests or score below minimally acceptable levels. \r\ eight districts en-r 
rollment in remedial courses or summer school is automatic. In the remaining; 
eleven districts , remedial work in various formats is mandatory. Six districts 
have policies whereby remedial assistance available at the student's option. 
Only three districts with minimum competency lasts have no policy, althoug^ 
remedial assistance is available if requested. \ 

Assistance in the regular classroom and enrollment in remedial courses are . 
the primary mecha.nisms through which assistance is provided students. Eighteen 
districts also provide students with tutorial assistance, 18 have skills Tabs and 
ten run before/after school drop-in programs. However, those three may_.npt be 
available in all schools for all students in every case. Remedial work is also 
available in summer school in ten districts. Eight districts-develop individual 
remedial plans or materials for students to use at home or in the classroom. 
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Court Action on Testing : 

As far as we could tell in this survey, 'no legal action has been taken 
against any of the Great City SchooV;districts for the use of minimum competency 
or other tests. The Florida state'^-mi nimum competency test which is administered 
in Dade County has been chal^efiged, but the case is still pending. 

Costs of Testing : 

Seventeen districts pay all costs of their student assessment programs. 
This includes five districts which administer state minimum competency tests. 
In the other districts which have state minimum competency tests, the state pays 
most costs for these tests. Three districts noted that the state pays costs of 
one or more mandated tests. 

We should give some recognition at this point to the fact that testing is 
not the only way, or even the most successful way, to assess student performance 
The progress of the" schools can be measured in terms which deal with attendance, 
levels of violence and crime, teacher turnover or burnout, dropout rates, and a 
host of other variables, some quantifiable and many-ndt. Again, the purpose of 
this report was not to judge the adequacy of the testing in our member districts 
but to provide detailed information to them on a topic that absorbs a great deal 
of their resources and shapes a good many of their programs. 



Individual District Profiles 
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ATLANTA 

The district currently uses standardized commercial norm-referenced 
achievement tests and state-developed criterion-referenced tests. State and 
district-designed minimum competency tests are now being field tested and will . 
go into' effect as a graduation requirement for the 1985 graduating class. 

PURPOSE OF TESTING 

At the elementary and secondary levels, NRTs are used for: 

S program evaluation 
I placement of students 

9 diagnosis of individual student strengths/weaknesses 

9 placement of students in remedi'al classes 

9 assessment of need for c.urriculum revision 

9 measurement of district-wide achievement progress 

9 determination of the need for teacher in-service training 

CRTs are used at elementary and secondary levels for: 

9 diagnosis of individual student strengths/weaknesses - 

9 assessment of the need for curriculum revision 

9 measurement of district-wide achievement progress 

9 determination of the need for teacher in-service trainirvg 

NRT results are also used for the evaluation of federal programs. The 
district matches test objectives to the curriculum. If test results indicate areas 
of weakness, work is done to reinforce the curriculum. 

/ 

SELECTION OF TESTS - 

Tests are selected by ad hoc ommittees formed when a decision to con- 
sider new tests is made. The committee Is generally comprised of resource personnel, ^ 
curriculum coordi nators , counsel ors , research assistants and teachers^^w-^pecimens 
are requested from publishers and presentations made to the committee. Specimens 
are also sent to a stratified sample of schools for review and trial. The final de- 
cision was based on 18 criteria and feedback from the schools. A copy of the cri- 
teria is available at the CGCS. 

When designing its own tests, items can be selected from the Atlanta Assess- 
ment Project, which is a state funded item pool, if they match local curriculum objec- 
tives. 

TECHNICAL INFORMATION 

The validity and reliability of the competency tests is in the process of being 
determined as part of the pilot testing. Pilot test results are also being examined 
- -"^to determine if test items contain cultural, racia,'Ir,.or gender bias. Item analyses 
with comparative outcomes of various groups are being conducted. 
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ADMINISTRATION OF. TESTS 

All students in all schools are tested in the students' schools. The 
tests are mailed out from a ce^ntral warehouse several days prior to administra- 
tion to test contact persons in each school who are responsible for test security. 
All tests must be returned. 

Research Assistants assigned to each school conduct workshops on test 
administration and interpretation of scores. 

Some special education and handicapped students are exempt from tests. 
However, it is recommended that all students take tests if possible. The state has 
large print tests available for vision impaired students but no special accommoda- 
tions are made for limited or non-Eng1 ish' proficient students. 

MANAGEMENT OF TEST DATA 

The district has a test data base for the C.A.T, The state provides'^the 
district with class rosters, information pertaining to mastery or non-mastery of 
objectives for students and for grade 10 students, scaled scores and state percen- 
tile. ' ■ 

State test result reports for each student, school and the district as a 
whole are sent to the Division of Research and Evaluation. These are then forwarded 
to principals, teachers-^ and counselors.' Research and Evaluation compiles the results 
for the administration, .comparing outcomes to previous administrations and other 
reference groups. 

Assistance 1s given to teachers on test result interpretation in workshops 
but the state provides reports which are well done and almost completely 
self-explanatory. The report to parents is in an easy-to-understand narrative. ^ 
Parents can also discuss results during parent-teacher conferences. 

Test data are printed on gummed labels attached to student records. 
One copy of the individual student report is also attached to the records. Students,^/ 
parents and persons responsibl e for instruction have access to the records. 

The research department and curriculum and instruction department arp/ 
separate units but representatives ^rom each work together on yearns for development. 
Research, Evaluation and Data processing is responsible for test administration. 

TEST RESULTS 

The state is presently in the process of developing standards and cutoff 
scores for the minimum competency test. It has a contract with Georgia State 
University to develop tests and recommend standards. The final decision will be 
made by the State Legislature. All data and decisions are reviewed by the state 
Student Assessment Advisory Council which, however, is advisory only. They do not 
make decisions or give approval. 
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ACHIEVEMENT TESTS (AH ANTA) 



lirade 
Tested 


Name of 
Test 


Des igned 
by V/hom 


Areas 
Tested 


Metric 
or UM* 


When 
Given 


NRT/ 
CRT 


Forms 
Used 


Norms 
Used 




General Purposes 


K 


Cal 1 fornia 

Achievement 

Test 


CTB/McGraw- 
Mill 


Pre-Reading 
Math 


Scaled 

Score 

NCE 

Percen- 
tiles 


April 


NRT 


Form C 


National 


To 


assess acfnevement 


1 


Ca] i fornia 
A( h i pvpiiion t 

f*^|ifVVV»|l'' ft Li 

Test 


CTB/McGraw- 
Hill 


Reading, Math 


All of 
above 

plus grade 
equiva- 
lents 


April 


NRT 


Form C 


National 


To 


assess achievement 


2. 3. 


Cal i forn fa 

Achievemi'nt 

Test 


CTB 

McGraw- 


Reading, Math, 
Language , 
Spelling 




April 


NRT 


Form C 


National 


To 


assess achievement 




Cal i fornia 

Achievement 

Test 


II 


Reading, Math, 
Language , 
Spel 1 ing, 


All of 
above 

plus grade 


April 


NRT 


Form C 


National 


To 


assess achievement 



Reference 
Skills 



equiva- 
lents 
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MINIMUM COMPETENCY TESTS (ATLANTA) 



lirade 
Tested 



Designed | 
b y Whom j 



Areas 
Tested 



"Metric 
or UM* 



Name of 
Test 



When 
Given 



"NRTT" 
CRT 



Forms 
Used 



Norms 
Used 



Gene ral P urposes 



4, 3 



Georgia 
Criterion 
Re ferenced 
Test 



.State Reading, 

Ma til, Career Develop- 
ment 



Mastery or March 
non-mastery; 
percent of 
students 
passing 
each objec- 
tive 



CRT 



To determine mastery or non- 
mastery of specific objectives 



10 



Georgia 
Basic 

Skills Test 



State Reading, Scaled 

Math, Problem Solving Score 



March 

(later 

also 

Oc tober) 



CRT 



To ixlentity students who have 
not mastered objectives for re- 
medial assistance: /ill be gr)adu~ 
ation requirement .starting school 
year 1982-83 



3: 



J 
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students who fail minimum^ competency tests will automatically receive 
remedial assistance in various formats which are now being developed. The district 
will pay for all remedial work although some funds may be available from the State. 



Test scores are not a factor in promotion decisions but as of the class 



of 1985, students must pass the minimum competency test to graduate even if all 
other requirements have been satisfied! Students will have a number of opportunities 
to pass the test but if they do not, a certificate of attendance will be awarded in 
place of a regular diploma. 

« 

The state covers all costs of the Georgia Basic Skills Test but the dis- 
trict must pay all other test costs including those of the state mandated Life 
Coping Skills Test which the district is presently developing. 



For fui;;ther information on Atlanta's student assessment program, contact: 

Dr. Garble "S. McCarson 

Divis,ion of Research and Evaluation 

210 Prydr Street, S.W. \ 
Atlanta; GA 30335 . . : 

Phone: (404) 659-3381 \ 
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The district uses standardized achievement tests published by commercial 
testing servi\ces and both state-designed and district-designed minimum competency 
tests. 

' purposes of testing 

Both, NRts and CRTs are used at elemeijfary and secondary levels; 

0 for program evaluation 
9 for placement of students 

9 for diagnosis of individual student strengths/weaknesses 

8 to place students in remedial classes 
• to assess the need for curriculum Revision 
§ to promote students from one grade to another 

9 to measure district-wide achievement progress 

In addition, CRTs are tised at the elementary and secondary levels to determine the 
need for teacher in-service training. Results are used in the evaluation of federal 
programs. 

** Both NRTs and CRTs are referenced against the curriculum. Item analysis of 

test results are sent to schools where curriculum modification may be undertaken in 
necessary areas. 

SELECTION OF TESTS , 

The district has no standing, test review committee. When necessary, test 
selection is conducted by personnel from the Office of Testing and Evaluation who 
draw on curriculum specialists from the elementary and sec(5ndary divisions. The Deputy 
Superintendent in charge of the Bureau of Educational Support Services also has input 
into the selection process and final approval. 

The p-articipants in the selection process review test specimens and material 
descriptions with an emphasis on test match to curriculum and assurance that the tests 
hc^ve been standardized for urban populations. -Publishers are also invited to do pre- 
sentations. Materials are sent to instructional personnel for review and the tests 
are piloted. The selection is not firm until the pilot test is complete and the data 
from the pilot has been analyzed and reviewed. 'Comp'eti tive bids ""are not received; 
cost is not the main selection criterion. 

When designing its own tests, the instructional division(s) are 'asked-to 
review behavioral objectives, scope and depth of the test, and to generate a' pool of 
items measuring each behavioral objective. The items are reviewed, revised to appro- ^ 
pri ate format, and piloted. Results and technical data are examined for validity and 
to assure that they are not out of line with preceding test difficulty criteria. 

t ^^.-^-^ 
TECHNICAL INFORMATION / 

The distirct uses a number of measures to determine the reliability of its 
district-designed CRTs including reliability coefficients KR20 and KR21, item 
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correlations, distractor information, discrimination indexes, Rasch score calibra- 
tions, and T-tests fit to Rasch. 

The- district relies on content and curriculum validity through the item- 
developed process and examines sub-samples to determine consistency. 

Racial and gender bias is remov^^ through the use of item and distractor 
analysis with group comparisons. ^ 

ADMINISTRATION OF TESTS 

All students fn all schools are tested and all testing is conducted in the 
students' -schools. The district's terminal proficiency tests are stored and inven- 
toried a* the Office of Testing and Evaluation. They are sent to building test 
coordinators prior to administration. Tfie test coordinators are responsible for test 
security in the schools and the i nv,entory ^and return of tests. Random sample obser- 
vation during test administration is also conducted. The non-terminal proficiency 
tests are stored in schools under lock and key. The writing test is revised annually. 

Special education students classified above level^three (self-contained 
classrooms and higher) are currently exempt from proficiency tests but will be includ-- 
ed in the future. Bilingual students must pass all tests in English. 

Training on test administration is givqn to faculty by test coordinators 
who may be principals or senior teachers experienced in testing. An instructional . 
manual is also available. 

MANAGEMENT OF TEST DATA 

The district has no integrated test data base. The test data are stored bi- 
annual ly, test-by-test. Current and historical test data for individual students can 
be constructed and retrieved via^student identification number. The district does 
have a' separate studen-t-d^trTas'e , and is planning to install a micro-computer system 
which wil I'-perfflnTTndividual teachers to access test data for planning purposes. 

Currently, the district generates numerous analyses which include Rasch 
scores, summary statistics (SAS package), class lists-, grade summaries, building 
reports, and regional and system-wide status reports. The data base allows for analy- 
ses by school', gender, race, language, and indirectly by SES. In addition to reports 
to teachers, principals, and administrators, the district also produces reportsfor 
any specially funded projects as well as Board of Superintendent requested ^tudies. 

Teachers receive item analyses of each student's proficiency test results 
for diagnosis. Staff from the testing office will go out and present programs on 
test result interpretation. Programs are also given at PTA meeting. Proficier^y test 
results are made available to parents. 

All test scores are printed on gummed labels and attached-^tBstudenf records 
to provide individual historicaT data . Teachers and principals have access to these . 
records on a need-to-know basis! Parents and students also have Jaccess upon request. 
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ACHIEVEMENT TESTS (BALTIMORE) 



tjrade 
Tested 


Nani'? of 
Test 


Designed 
by Whom 


Areas 
Tested 


Metric 
or UM* 


When 
Given 


NRT/ 
CRT 


1 U 1 iMo 

Used 


Norms 
Used 


Pre-K 

r 


Boehrn Test 
Bask of 
Concepts 


Psych Corp 




Raw Score 
Percenti le 


Sept/ 

Oct ^ 
Apr/May 


NRT 


Form A 


Publ i sher 


K 


Bochm Test of 
Basic Concepts 


Psych Corp 


• 


Percentile 

Scaled 

Score 


Sept/ Oct 
Apr/May 


^nrt" 


Form B 


Publ isher 


K 


Metropol Han 
Pre-Prinier 


Psych Corp 




II 


II 


Nt^T 


Form JS 


Publ isher 


2 


-^Cal i fornia 
Arh 1 p vpinph f 
Test 


CTB/McGraw- 


Reading, Math, 

1 zi nni 1 a no 
Ldliy Udyt: 


Grade 

Ecju i val en t 


Nov (Pre) 
nay \rost^ 


NRT 


Form C 


Publ isher 


3,5. 

8 


Cal i fornia 

Achievement 

Test 


II 


M 


II 


M 


NRT 


Form C 


Publ isher 


9 






II 




II 


NRT 


Form C 


Publ isher 



Ge neral Pu rposes 



Placement of students; to mea- 
sure student progress-Title I 
school 5 

[Placement of students; to measure 
student progress-Non-Title I 
school s 

Title I schools only, to measure 
student progress, placement of 
students 

To measure system-v 'de progress/ 
diagnosis of indiv uol students, 
school ranking, determination of 
target schools' individual pupil 
profiles 



Title I 




4 
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MINIMUM COMPETENpy TESTS (BALTIMORE) 



Tested 



1-9 



3-8 



3-9 



7&9 



Name of 
Test 



Pro fie loncy 
Test In 
Writing 



Proficiency 
Test in 
Math 

Proficiency 
Test 

in Reading 

Maryland Func- 
tional Reading 
Test 



Designed 
b y Who m 



District 



Distri9t 



District 



State 



Areas 
Tested 



Writing 



Math 

Reading 

Reading 



Metric 
or UM* 



When 
Given 



CRT 



Percent 
1 terns 
correct 



Percent 
1 terns 
correct 

Percent 
1 terns 
correct 

Percent 

Items 

correct 



April 



April 



April 



Oct 



CRT 



CRT 



CRT 



Fonns 
Used 



Nonns 
Used 



GeneraJ_PurpoS(*s 



Purposes : Curriculum assessment, 
placernent of students, diagnosis of 
students, instructional serv-ices, 
graduation requirement. If students 
do not pass terminal test 1n grade 9, 
tests may he re- taken twice eacli 
year through grade 12, after place- 
ment in remedial class until passed. 

Purjiojesj Same as above except 
te'riiTinal" test is in grade 0. 



Purposes : Same as 1 Writing 



To identify students needing remedial 
help. District gi^aduatlbn require- 
ment since 1979, State requirement 
as of Class of '82 



*As part of Project Basic, the State Competency Program, competency tests In Mathematics, Writing, and Life Skills. Effective Dates: September 1982 
- f^^athh SpHng 4^B3H^^^ - 



4 ' 
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The district has maintained a test file back to the 1960s. Historical test 
data, by student, have been maintained since Fall 1977 but must be accessed by test. 

The Research Department and Curriculum and Instruction are independent, but 
assignments are carried out in consultation. Proficiency testing, state testing and 
achievement testing are administered by the Office of Testing and Evaluation. 

The standards for passing the district's minimum competency tests were set 
by the Superintendent, the Board of Education, personnel form Secondary and Elementary 
divisions and the Operational Cabinet which is composed of the Superintendent, Deputy 
Superintendents, Regional and Assistant Superintendents, and division heads. A deter- 
mination of reasonable scores based on assessment of results was made taking into 
consideration legal implications. When test results show that students' are reaching 
minimal competency at the^ 90% level on a specific objective, it is up-graded to match 
the average level of competency. The cut-off on the district's proficiency tests is 
70% and on the state test 80%. 

Failure on the district's proficiency tests is a signal that remedial support 
must be provided. This support is available in the -regular classroom, in remedial 
courses, in summer school, through tutorial assi stance, and in skills labs. If a stu- 
dent fails' a terminal proficiency test, enrollment in a remedial course, which substi- 
tutes for an elective at the secondary level, is automatic. The district pays for all 
remedial work.^ 

Proficiency test results are a factor in promotion decisions. All retention 
decisions are reviewed by a school board committee which also takes into consideration 
teacher reports, classroom performance, and the number of times previously retained. 
The same considerations apply to placement for remedial work. 

Students must pass the district competency tests in reading. Mathematics, 
and writing to graduaj:e, even if all other requirements have been satisfied. No spe- 
cial diplomas or certificates are given to those who do not pass. Students are not 
required to leave school and may also return to take tests. 

Minirfium achievement levels are specified by both the district and the state, 
but no legal actions have been taken against the district for the use of test since 
the policy was established in 1978-1979. 

The state provides the state test materials but does not pay for computer or 
personnel costs associated with these tests. Except for Title I, all other costs of 
the student assessment program are paid for by the district. 

For further information on Baltimore's student assessment program, please 

contact: 



Mr. Jacob Schuchman, Coordinator 
Office of Proficiency Testing 
Baltimore Public Schools 
2330 St. Paul Street, 2nd Fir. 
Baltimore, Maryland 21218 



Phone: (301) 396-7475 



or Mr. Leonard Granick, Director 
Office of Testing ?i Evaluation 
Baltimore Public Schools 
School 79-Portable 
2801 N. Dukeland Street 
Baltimore, Maryland 21216 

Phone: (301) 396-0366 
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BOSTON 

^ The district uses standardized achievement tests published by a eommer- 
cial testing service and both state and district-designed minimum competency tests, 

PURPOSES OF T" ]m - 

The district's commercially published NRT's are used primarily to measure 
district-wide achievement progress and for Title I placement. Another NRT is used 
for placement of students in the district' s ^I'exam" high schools. One commercially 
published CRT is currently used for diagnosis of individual student strengths and 
weaknesses. Another GRT is also used as part of the district's minimum competency 
testing. NRT test results are used in the evaluation of federal programs. 

The tests were chosen on the basis of their relevance to the curriculum. 
The relationship between the student assessment program and curriculum improvement 
efforts lies at the individual teacher level. Teachers receive test results, de- 
termine students' needs ani modify instruction accordingly. 



SELECTION OF TESTS 

Tests are selected by ad hoc committees consisting of central, district 
and school level personnel.. The committee determines the selection policies and 
criteria. Test specimens are examined for their relationship to the curriculum and 
with regard to reliability, validity and representativeness of the norming popula- 
tion. Bids are not sought on an annual basis. * 

Item banks or pools are not currently used in the district since the only 
district-designe'd test' is a writing test. Teachers are asked to recommend topics 
students can write about for this test. 

TECHNICAL INFORMATION 

When topics are suggested for the district-designed writing test, they 
are screened to assure that cultural, racial, and gender biases are excluded. Jhe 
tests are scored holistically. Raters take into account the mechanics of writing 
(e.g., grammar, spelling, and punctuation), as well as theme development. 

The district uses inter-rater reliability to assure that the evaluation 
of student writing tests is accurate and consistent. Two trained readers evaluate 
each test. If there is a discrepancy greater than one point between the two evalu- 
ations, the evaluation i"s reviewed. 

ADMINISTRATION OF TESTS 

Currently, all student's in Grades 1 through 11 in all schools are tested 

with an NRT in reading, and in Grades 4, 6, and 9 in math, although there is some 
discussion of sampling plans in the future. All testing is conducted in the stur 
dents' schools. 



Numbered- tests and pre--eoded answer sheets are -sent to school prineipa-Vs 

who are responsible for their 'security in the schools. Workshops on test pr.o'cedures 
are held at a central location for building test coordinators. They, in turn, train 
faculty members with the emphasis on new teachers. 

Exemption of special education and limited English proficient students 
from state tests is determined by teachers on an individual basis. The general rule 
is to test as many students as possible when appropriate. The CTBS Espanol is 
available for Spanish-speaking students and the M.A.T. is available in large print 
for vision-impaired students. The physically handicapped are assisted on an indivi- 
dual^ basis on the M.A.T. with methods appropriate to their needs. 

MANAGEMENT OF TEST DATA 

The district maintains test results from all achievement and competency 
• tests on /tape by test and student. The Information Systems Development department 
maintain^ the test data base with test results keyed to student indentification 
number. |The Department of Implementation maintains the student data base which 
has persbnal data on students.' The capacity thereby exists to merge data from the 
two departmehts to perfor^^ test score analyses. 

/. In addition to individual student scores, the data. base aggregates scores 
by grades in individual -schools, by subdi s-tri cts and for the system. Percentiles,, 
grade^quivalents, and'stani nes are reported by grade and race for each level. The 
data base also-allows for analyses by gender. 

A summary report showing grade equivalent units, and comparisons by year 
are sent to the press and District Advisory Councils (.parent groups). 

Te^achers received training on interpretation of test result printouts from 
the ICRT through in-service workshops. Parents receive written reports stating 
whether or not students met standards on the ICRT., and they may meet with teachers 
for information during the schools' open house. 

. Only the results from the M.A.T. are recorded, on labels placed on stu- 
dents' permanent records. State competency test results are only on temporary 
records. School level personnel, parents, and students have access to the records 
upon request. No longitudinal data have been developed but the tapes to do so do 
exist. . ' 

Currently, the district has no research or testing department, although 
the system is presently undergoing structural changes. Proposed plans include the 
placement of testing and evaluation under the supervision of the Deputy Superinten- 
dent of Curriculum and Instruction. At present, test administration is the respon- 
sibility of the Office of Curriculum and Competency. 

TEST RESULTS 

Standards for passing both the district-designed and state minimum com- 
petency tests were set by a steering committee of teachers, parents and community 
representatives The standards set by the committee were subject to state approval,. 
In reading, students in Grade 2 must score 60 correct out of 70 items, and 24 out 
of 34 in math In Grade 5 students must score 26 out of 40 correct in reading and 
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Tested 



l-il 



4. 6. 

9 



2 & 
5 



6 & 

8 



flame ul~ 
Tent 



Metropol Itan 

Achievement 

Test 



Metropol itan 

Achievement 

Test 

Individual 
Cr } terion 
Referenced 
test 



Secondary 
School 
Admissions 
Test 



Designed 
by Whom 



Psych Corp 



Psych Corp 



Educational 
Progress Corp 
Tulsa, OK 



ETS 



Areas 
Tested 



Metric 
or UM* 



When 
Given 



Reading 



Math 



Reading 

and 

Math 



Battery 



Grade Oct 
equivalent, Per- May 
centile, Stanlne 



Grade Oct 
equivalent, Per- May 
centile, Stanlne 



Percent 
objectives 
passed/needs 
remedial help/ 

failed 



May 



Dec 
Jan 



nrt7~ 

CRT 



NRT 



NRT 



CRT 



NRT 



Forms 
Used 



No rms 
Used 



General Purposes 



National 



National 



May - r.jasure district-wide 
achievement progress 

Oct - Title 1 pre-test; for 

placement in grade 4,5, 
6 advance work classes 



Diagnosis of individual student 
strengths/weaknesses, to determine 
need for remedial work, also used 
as minimum competency test in 
compliance with state approval 

Placement in "exam schools" 
(Boston Latin, Boston Technical 
H.S., Boston Latin Academy) 



4-12 



Degree 

of Reading 

Pov^er 



Col lege 
Board 



Reading 



DRP 
units 



March 



Absolute 
Scale 



3. 4. 

5 



CTBS 



CTB 

McGraw-Hill 



Reading 
Math 



*See 

General 

Purpose 

of 
Testing 



*For selection of students for 
advanced classes In bilingual 
Y (administered by Bilingual office) 



4. J 



'J 
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MINIMUM COMPETENCY (BOSTON) 



I- urade 
Tested 

2, 5 



8 ' 



Name \\f 
Test 



Boston 

Writing 

Test 

State 
Minimum 
Competency 
Test . 



OeslgnedT 
by Whom 



District 



State 



Areas 
Tested 



Metric 
or UM* 



When 
Given 



NRT7" 
CRT 



Forms 
Used 



Norms 
Used 



Writing 



Reading and Math , 
equals percent ob- 
jectives passed 



Holistic 



Holistic 



Spring 



Spring 



General Purposes 



To determine minimum competency 
in writing in compliance with 
state mandate 

To determine minimum competency 
in areas tested 



7 



5 
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19 out of 34 in math. Orirthe' 8th grade state-designed test, students must answer 
32 out of 55 correctly 1n reading and 31 out of 59 in math. Currently, an average 
of SS% of the students at all three grade levels pass the test. 

Students who fail the tests receive remedial ass^istance in their-regul ar 
classroom. Individual rerriedial plans are developed and at the secondary level 
(Grade 8) students retake the test until they pass. No other forms of remedial 
assistance are available. \^ 

Test results are not fopmally taken, into account in j?romotion decisions. 
Class work and teacher recommendations are other factors considered. As the com- 
petency tests were only recently implemented, no policy 'has been determined at 

this point with regard to graduation and diplomas for those who od not pass, 

t> 

The specification of minimum achievement levels for students is a local 
option subject to state approval. No legal actions have been taken against the 
district for the use of any tests. 

The district pays the entire cost of the student assessment programs 
including the state-designed and mandated minimjm competency tests'. 

For further information of Boston's student assessment program, contact: 

Dr. Virginia M. Cahill . . 

Office ofsPlanning and Policy 

26 Court Street 
Boston, MA ^ 02108' 

Phone: (617) 726-6480 
^ 726-6481 
726-6482 
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BUFFALO 



Th6 district uses standardized achievement tests published by a .commercial 
test service and state-designed minimum competency tests. 



PURPOSES OF TESTING ^ 
NRTs are used at both elementary and secondary levels: 

6 for program evaluation 
' % for placement of students ' . ,. 

• for diagnosis of individual student strengths/weaknesses 

• to place students in remedial classes 

9 to assess the need for curriculum revision 
e to measure district-wide achievement progress. 

CRTs are used for placement of students in remedial and other programs. The -results 
are also used in the evaluation of federal programs. \ 

Tests are referenced against the curriculum. The evaluation department 
feeds data to the curriculum department which write curriculum programs. As part of 
the curriculum development, test results from prior years (prepost models) are used. 

SELECTION OF TESTS 

-When-te-s-ts-a-re-to-^- be selected, an ad hoc committee .is formed. The' com- 



mittee always includes the Directors of Evaluation, Curriculum, Reading, Math and ^ 
Language Arts. Teachers and counselors have been included in the past. 

The committee develops an ad hoc model for evaluating the tests. Sample 
packages from commercial publishers are reviewed and analyzed with regard to content 
and reporting. Publishers are then invited to make presentations and the committee 
makes the final selection. Competitive bids are not received. ^ . . 

ADMINISTRATION OF TESTb 

Students in all schools are. tested and all testing is conducted in the 
students' schools. Tests are inventoried. Each school mu^t request a specific 
number of tests which are delivered no wore- than a week prior to test time. Tests 
are stored in the school safe and test security is the responsibility of .building 
test coordinators who must also assure that all tests, are returned. 

Very-limited- English proficient 'students and students with handicaps which- 
would preclude successful completion are exempt from NRTs. No adaptations of these 
tests are made for handicapped or limited English proficient students. 

J On the state competency test , ' al ternative testing techniques are used for 
"pupils Whose native language is. other than English who first enter, after grade 
eiqht, sdhools where the predominant language of instruction -i s English. Alternative 
^ testing techniques are also available for students with 'handicapping conditions . 



students are exempted from a State comprehensive test requirement for gradu- 
ation if they have scored a-bove a certain level on College Entrance Examination Board 
tests or American College Testing Program tests or have passed State Regents examina- 
tions in English and math. "Alternative tests" may be used for students "who have not 
pa.ssed the examinations .because of extraordinary administrative circumstances not 
caused by the Willful act of the pupil or of a teacher or administrator". 

MANAGEMENT OF TEST DATA " ^ ' . 

The district maintains a central test data base for the Metropolitan 
Achievement Tests which includes test items and results by student, and pupil dis-^ 
criptors such as namej^.D. number, school grade, and date of birth. The data can 
also be keyed by school. A separate student data base is mainta,ined but analyses of 
test results by gender and race can be conducted by mixing the files. 

The district reports means, standard deviation, prepost evaluation of ^ 
difference of me.ans with F-tes.t, and item analyses by individual, class and school _ • 
summary. ^ • . 

Teachers receive M.A.T. subscbres and Totals and all reported metrics for 
their pupils. Principals receive grade level summaries for their schools and a 
district-wide report by grade for reading and math is spnt to the Superintendent and 
Board of Education . 

Assistance for parents and teachers with test result interpretation is .the 
responsibility of school principals. Parents are also provided information and assis- 
tance on conference days and may review pupil records at that time. ^ 

Gummed labels showing test subscores and total scores, pre and post for the 
M.A.T. are attached to student cumulative records. 

The M.A.T. results by student have been maintained for the last two adminis- 
trations. • " 

The Curriculum Department is located in the Division of Instruction. The 
Department of Evaluation which is responsible for test administration is in the 
Bureau of Research and Administrative Services in a separate division. Curriculum 
and Evaluation staff cooperate irv evaluation design and curriculum development. 

TEST RESULTS 

The standards and cutoffs for the minimum competency test are determined by 
the state. Students who do not score wel i on tests from grade 3 on receive automatic 
remedial assistance. Assistance may be provided ..in the regular classroom, in remedial 
courses, in summer school, by tutors and in skills labs. In addition, the district 
uses models such as small class size or reading consultants to help teachers develop 
individual remedial plans as part of the regular curriculum. 

Test results are not usually a factor in promotion deci sions ,al though they 

-^423?*^.-— could be used as support one way or another^ As of the class of 1982, students must^ 

pass the competency test to graduate-even if all other requirements have been satisfi€ 
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ACHIEVEMENT TESTS (BUFFALO) 



Pre-K 
K-12 



Munie of 
TOBE 



Metropol itan 
Achievement 
Tests 19/8 



by Whom^ 



Areas 
Tested 



Metric 
or UM* 



When 
Given 



"NRT7" 
CRT 



Forms 
Used 



"Nonns 
Used 



McGraw-lHll Language, Hath 



Psych Corp Reading, Math 



No rma 1 
curve 
equivalent 



Oct (Pre- NRT 
May- Post 

Oct and NRT 
May (Pre- 
Post) 



Level K 



Primer 
K5 

Primary I 
Primary 2 
Elementary 
Intermediate 
Advanced 1 
Advanced 2 



National To test readiness for school 



National Program evaluation, student 

placement, diagnosis of students, 
to measure district-wide achieve- 
ment progress curriculum assessment 



■ I 



A 



ERIC 



-44- 



J o 



J I 



MINIMUM COMPETENCY TESTS (BUFFALO) 



lirade 
Tested 

3 h 6 



If;l 



Des igncd*^ 
Jby Whom 



Pupil Evalu- 
ation Program 



Prel iminary 

Competency 

Exam 



State 



State 



Areas 
rested 



Matfi, Reading 



Reading, 
Writing 



Metric 
or UM*^ 



6th Grade 
Reading - 
DRP* 

DRP* 

Holistic 



When 
Given 



NRT/ 
CRT 



Forms 
Used 



Fall 



CRT 



Annual ly CRT 



Norms 
Used 



General Purpor> es 



Checkpoints as part oF State Regent's 
Competency Test Program 



CliGckpoint to provide remedial assis- 
tance 



11 or 
12 



Regents 
Competency 
Fx am 

Regents 

Competency 

Exam 



State 



State 



Math 



Reading , 
Wri ting 



Raw Score 
Pass/fail 



DRP* 

Holistic 



Jan and CRT 
June 



Jan and CRT 
June 



Graduation requirement 



Graduation requirement 



*DRP - degree oF reading power 
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students who do not pass will not receive any diploma or special certificate. They may 
return to retake the test until age 21. 



The entire cost of the student assessment program, including state tests^^is 
paid for by the district. 

For further information on the Buffalo student assessment program, contact: 

Ronald E. Banks 

Director of Evaluation ' ^ 
Buffalo Public SchofoHs 
Room 711, City Half \ 

Buffalo, NY 14202 j • ' 

Phone: (716) 842-4660 . . ^ 
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CHICAGO 



This district uses standardized achievement tests published by a commercial 
testing service, district-designed criterion referenced tests and a district-designed 
minimum competency test. 

PURPOSES OF TESTING 

Both NRTs and CRTs are used to varying degrees at elementary and secondary 
levels: ' 

0 in program evaluation 

9 in placement of students 

* In diagnosis of individual student strengths/weaknesses 

™9* to place students in^ remedial classes - - 

1 to asses'i the need for curriculum revision 

9 to promote students from one grade to another 
8 to measure district-wide achievement progress 

• to determine the need for teacher in-servi ce ^training 

Test results are also used in the evaluation of federal programs. ^ 

The district's CRTs are referenced against the curriculum. They were 
developed in response to a need for standardization across Chicago schools with 
regard to what a minimum program in each subject area must contain. Objectives for 
each program and grade level were developed and tests were designed to measure 
mastery of the objectives.' Changes were made in the curriculum on the basis of the 
pilot test results. As the mastery learning programs are stiTl in formative stages, 
further revisions in the programs and tests are possible. The reading mastery ^learn- 
ing program is currently being revised after the first broad based implementation in 
grades K-8. 

SELECTION OF TESTS 

Selection of the district's commercially published NRT was conducted by an^ 
ad hoc committee consisting of personnel from Research and' Evaluation, Curriculum, 
Elementary and Secondary administration, teachers, guida^e counselors, community 
representatives and teachers. For guidance in the selection process "pne-set criteria 
and a test evaluation form were used. Copies of both are availxbl_e__a^he^ 
<^ 

The committee reviewed tests from seven major pub14s-her-s-a-nd~eH^ 
two of them on the pre-screenlng. The^five remaining publishers each conducted a 
pilot study in twelve of the district's schools. The costs of the pilot studies 
were paid 'by the publishers. The resHilts were analyzed by Research and Evaluation 
and a report was written. The Curriculum Department provided input regarding test_ 
match to the cumiculum and the match of ma'stery-tbjecti ves to test items. Affective 
responses of STfiool ■ 1 evel personnel to the testes were also reviewed. 

When designing its own tests, the district does not use item banks or pools 
Test items are developed by relevant teacher committees. ■ 
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TECHNICAL INFORMATION 



Each new distri ct-desi gned .CRT and each new version of district-designed ^ 
tests is piloted in several schooU. Each subtest is measured to determine reliabilit 
using KR-20. Reliability measurements, have always been in excess of .9 on implemented 
tests . . ' 

> The Curriculum Department determines face and content validity of the 
Crjter4ipn Referenced Tests used to measure mastery of curriculum objectives. The 
^diTtrTct relies on content validity for the Chicago Mini'-,'jrr P-o-iciency Skills 'Test 
as determined by the company which developed and did tha first study of the test. 
Approximately 20''i o^" tne items are changed each year but ihe forrat remains the same. 

Item analyses using group comparisons are conducted to assure that cultural, 
racial and gender bias have been excluded. 

A DMINISTRATION OF TESTs ' ^ ' ( 

- — , 

All students in all schools are tested. All testing is conducted within 
students' schools. The district-designed CRTs are stored in departmental offices. 
Proficiency tests are stored at the Department of Research and Evaluation and sent 
out to the schools prior to administration. Schools are asked to account for tests 
but lack of personnel makes assurance uncertain. 

Special education students are exempt from the Proficiency test unless it_ 
is a part of their I.E.P.^ No adaptations are made for limited and non-Engltsh profi- 
cient students. They must pass the test in English to graduate. 

" The CRTs are given to. all students. Special Education students take tests 

whenever possible. Adaptations may be made on an individual basis for handicapped 
students. The CRTs are available in Spanish since the majority of second language 
students fall in this category. Other language curricula are available but no tests 
are in place, 

MANAGEMENT OF TEST DATA 

Test results are maintained year by year on all students tested. Profi- 
ciency test results and current year achievement test results are recorded on the 
student data base. However, the entry of each year's test results orthe absence of 
current year testing automatically deletes previous year entries,- Longitudinal 
test-data on-i-nd-ividual students can only be obtained by accessing each year's 
test results by student I.D. number. The district is currently in the process of 
developing a base with eight years of test data on Individual students. 

Test results are analyzed using regression techniques, frequency distribu- 
tions and summary statistical measurements. Analyses by school are drawn from the 
test data base while the student data base permits analyses by gender and race for 
current year results. 

Test results are summarized by scho'^l for each age level and by quartiles 
for I.T.B.S. subtests for city-wide press release. Individual school reports are 
provided for principals. I.T.B.S. item analyses and item grouping; by individual 
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ACHIEVEMENT TESTS (CfllCAGO) 



Jestt'd 
2-8 



9 

9-12 



8-12 



Nfline of 
Test 



Des igned 
by Whom 



Areas 
Tested 



Metric 
or UM* 



When 
Given 



\CRT 



Forms 
Used 



Norms 
Used 



General Purpo ses 



ITBS 



Test of Aca- 
demic Progress 

Cri terion 
Re ferenced 
Tests 



Riverside 
Publishing 



Unit Subject 
Tests 



Chicago 
Minimum Skills 
Proficiency 



Riverside 
Publ ishing 

District 
(Curricu- 
lum and 
Research 
Evaluation) 

Teacher (^pm- 
mittees and Re- 
search and Eval- 
uation 



District 
(original test 
developed by 
outside con- 
tractor) 



Vocabulary, Readr 
ing. Math 



Reading, Math 
Reading, Math 



English, General 
Science, Pre- 
Algebra, Algebra, 
English II, III, 
IV, Geometry, 
Biology, Foods 
(Home Economics) 



Language Arts, 
computation and 
problem solving, 
life skills - 



Grade equiv- Spring NRT 
alent, per- , 
centlles . \ 

Stanines 

Percentiles Spring NRT 



Mnstery/ ^ CRT 

non-mastery, 

percent 

correct 



Percent — CRT 

correct 



Form 6 



Form S 



Na tional 



National 



COMPETENCY TEST 
Pass/fail CRT 



See page i 



To determine mastery or no n -mastery 
of specified course objectives, 
factor in promotion decisions, to 
assess student strengths/weaknesses 
remedial needs 

To assure mastery of minimum course 
content 



Graduation requirement to assure 
students possess minimum skills 
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jdent are giy-^rTto classroom teachers. Summary reports on the percent of students 
pas\lng the Pr/oficiency Test as well as a listing of students who did or did not pass 
are [sent to tne schools. 



Res 

in^erpretatio 
lA^e in turn r 
lided. 



arch^'and Evaluation provides in-service training on test administration, 

and use of cest results for designated school test coordinators who 
sponsible for school faculty training. Written information is also pro- 



le disr,emination of test result informatio.n and assistance to parents on 
teVtr-rgsult ir-l:e>^':-"etarion are local school options. Report cards show the number 
of units the st-jdent ni: mastered in the Mastery Learning Program. 




Press labels with I.T.B.S. subscores and totals and Pro-'- 



mCV 1851 



pass/fall notations are placed on student records. Mastery Record Cards for each 
student in reading and math as well as other test data travel w::h the student from 
classroom teacher to classroom teacher. Parents, principals, adjustrent teachers 
(counselors), classroom teachers and Research and Evaluation personnel have access to 
student records. 

In addition, a Class Progress Record by individual student is posted on the 
wall of each classroom and updated by the teacher. Each school principal posts a , 
Principal Progress Record which summarizes the Class Progress Record of each classroon 
In turn, a summary by school is maintained by each District Superintendent and provide 
to the General Superintendent and the Boa'rd of Education. The Superintendent of 
Schools and other administrative personnel monitor classrooms and schools to assure 
that the Records are posted. 

Test data have been maintained since at least 1971. However, since the 
I.T.B..S. was implemented in 1975, any comparative analyses using results prior to thai 
time are pending the results of equivalency studies. 

Research and Evaluation and Curriculum are independent entities with dif- 
ferent reporting lines. Research and Evaluation pilots tests, ideas and transfers 
information to Curriculum for consensus. Research and Evaluation is in charge of 
administration of achievement and Proficiency tests, ^^hile Curriculum administers 
the CRTs. 



TEST RESULTS 



To set sta^^ for passing the district's minimum competency test, 500. 
young adults who hadVen employed at least six months in five different Chicago 
firms and who were considered successful employees were tested. The distribution 
of their scores was exam\|ied, and a reasonable cutoff point determined by the Directo 
of Research and Eval uatiori and the Project Manager. The cutoff was set at the 'end of 
the second stanine or approximately at the 19th percetitile of young adults who were 
coping. 

Remedial courses or remedial work are automatic for- students who fail 
tests or score below minimally acceptable levels. Students who fail, the Proficiency 
Test are programmed into the Proficiency in Basic Skills course until they pass the 
test. 
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First graders who do not meet rainimum mastery expectations of the 
Chicago Mastery Learning Reading Program are. placed in a pre-second grade program 
and provided an appropriate support program. In other grades students are provided 
with appropriate instructional support programs. Students may be retained for a 
full semester or year, to be determined by the nature of the remedial program im- 
plemented by the local school and the organizational structure of the school. 

In addition to remedial assistance in the regular classroom, and remedial 
courses, volunteer, cross-age, and teacher tutorial assistanca are also available 
to students . 

To be promoted from one crade to a^zz'^sr students-must demonstrate mastery - 
of approximately 79% to 83^ of t'-/ cage "^-rary Learning Reading, units., The_ ^ 
deci.^fon is made on a child by child basis and not through the use of cutoff poin.s 
based solely on the results of standardized tests. Criteria for promotion include \ 
results from standardi zed ' tests , raid-year and end-of-year .tests, learning patterns 
as recorded on the Student Progress Record and developmental criteria related to 
social, emotional and physical growth. 

Students must pass the Chicago Minimum Proficiency Skills Test to graduate 
evan if all other requirements have been satisfied. Students who have not passed 
the test by the end of 12th grade may attend summer school or night school until the 
test has been passed. Because the district has nevgr has never had a student who did 
not ultimately pass the test, no policy with regard to diplomas or certificates of 
attendence exists. 

Minimumachievement levels are presently specified by the district. To date, 
no legal actions have been taken against the district for the use of any tests^ All 
costs of the student assessment program are borne by the district. / 

For further information regarding Chicago's testing program, please contact: 

Dr. Elmer M. Casey 

Director of Testing 

Department of Research and Evaluation 

2021 N. Burling Street 

Chicago, IL 60614 

Phone: (312) 641-8006 




CLEVELAND 

The district uses standardized tests published by commercial testing firms 
PURPOSES OF TESTING 

The tests are used at both elementary and secondary levels: 

• for program evaluation 

9 to describe specific learning difficulties of school and class groups 

• to assess the need for curriculum revision 

tp measure di-strict-wide achievement progress 

The results are also used in the evaluation of federal programs. 

The assessment program is only one piece of the whole curriculum effort. 
Curriculum and Instruction personnel examine test results ^or areas of strength 
and weakness and redirect development efforts in the needed direction. The tests 
are referenced against the curriculum. 

S.ELECTION OF TESTS 

The district has a standing test review committee comprised of adminis- 
trators, supervisors, principals, teachers, research and development personnel, 
representatives from administrators' and teachers' unions. Parents and students 
come in as a subgroup of the review process. Publishers are invited to appear 
before the review committee. Tests are measured against pre-set' criteria (a copy 
of the criteriaM's available from the *CGCS). The test selected by the committee 
is field tested before final implementation. Competitive bids are not received. 
Price is a factor in the decision process but the main factor is the relevance of 
the tes.t to the district's program. 

TECHNICAL INFORMATION 

The district carefully examines the publishers' evidence for reliability 
and validity. Test results have' been -found to correlate with district students' 
school achievement. 

The district also examines the commercially published tests for exclu- 
sion of cultural, racial andbgender bias prior to purchase. However, it plans 
to apply the Logist Test, an item analysis using CHI-sqiiare, to district student 
test results to see if patterns of response vary among groups. 

ADMINISTRATION OF TESTS 

All students in Regular and Major Work classes are included in the 
City-Wide Testing Program. All testing is conducted in the students schools. Test 
security is the responsibility of school principals and department chairpersons. 
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Limited and non-Engl ish- proficient students as well as .special education 



students are exempt from the regular City-Wide Testing Program. A special testing 
program utilizing NRTs has been established for EMR students. Large print tests 
are available for vision impaired students. 



In-service training on testing procedure and interpretation of test 
results has taken place but not all teachers in all schools have Been reached. 

MANAGEMENT OF TEST DATA 

Test results for the district are maintained on tape.V An individual 
student's test results can be accessed by student liD. number. The student data 
base is separate and contains no test results. Test results can be accessed by 
geographic subdivision, by school, grade, gender, race, and curriculum area.* Tapes 
of test results have been maintained for five years. . 



The district reports Stanines, all summary data, and item analyses for 



each class and school as well as the district as a whole. Staff and faculty, 
r^eceive complete and technical reports while the public receives summary data. 
Individual test results are not sent home to p^arents . 



Subtest and total scores are recorded on student r'ecords. Teachers, 
principals, administrative staff, parents and students over 18 have access to stu- 
dent records. ^ 



The Research Departm^fit and Curriculum and Instruction Department are 
separate but they coordinate efforts and analyses. The Division of Research, 
Development and Evaluation is in charge of test administration.. 

TEST RESULTS 

The schools do sometimes operate programs outside of regular classroom 
instruction to prepare students for tests. These programs are voluntary and 
supplemental to regulaf cla.ssroom work. 



The district has no minimum competency test.. ^ 

The dis'trict pays the entire cost of the student assessment program. 



Dr. Margaret Fleming 
Cleveland Publ ic- -School s 
1380 East Sixth Street 
Cleveland, OH 44114 

Phone (216) 574-8000 • 




For further information on Cleveland' s- testing program, please 



contact: 



/ 



/ 



/ 
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* ACHfEVEflENT TtSTS (CLEVELAND) 



bradc' 
Testrd 



Designed 
_by Whqm_ 



Areas 
Tested 



Metric 
or UM* 



When 
Given 



Forms 
Used 



6. 0. 
11 



7. 9. 

12 

h 4, 
6. 7, 



5 
3 

8 

4-9 



Metropolitan 
Readiness Test 



1. 2 CTOS 



3. 4 



Cognitive 
Abilities Test 



Stanford Dlfl- 
nostlc Test 



Psych Corp 

CTB/McGraw- 
Hill 



Riverside 
Publishing 



Psych Corp 



Readiness 
Reading 



Reading and Lan- 
guage 



Stanines 



Reading 



Mathematics 



Mathematics 

Abstract Reasoning 
Ability 



Reading 



S til n I no s 



May 
May 

May 

May 
May 

(Grades 0-11 
Language-Jan) 

May 

3, 4, 6: 
MarchVApril 
7: March 
8: January 

April 

Nov 

Jan 
Sept 



NRT 
NRT 

NRT 

NUT ' 
NRT 

NRT 
NRT 

NRT 
NRT 

NRT 
NRT 



Fonn S 

Form S 

Fonn T 
Form S 

Form S 
Forn^ S 

Form T 

Level Pri 
mary 2 

Level 1 

4-6: Fdi-mA 
4 Green 
level ; 
5 and 6 Brown 
levels; 7 and 9: 
Form B Brown 
level 



Norms 
Used 



National 

National 
and Large 
City 



Gen er a 1 Purpos e s 



Items under Purposes of Testing 



National 



ERLC 



•54- 



DADE COUNTY 

The district uses standardized achievement- tests published by a commer- 
cial testing service artd-^state designed minimum competency tests. 

c 

PURPOSES OF TESTI NG 

NRTs are used at both the elementary and secondary levels for program 
evaluation, placement of students, diagnosis, placem.ent in remedial classes, assess- 
ment of need for curriculum revision and for measurement of district-wideachieve- 
ment progress. CRTs are used for similar purposes and are also a factxor in promo- 
tion decisions. Test results are used in the evaluation of federal ^gpbgrams. 

The CRTs are referenced against the district-designed curriculum. Curric- 
ulum personnel analyze areas of weakness from test results and modify and strengthen 
necessary areas in their programs accordingly'. 

SELECTION OF TESTS 

In the most recent test selection process, an ad hoc committee consisting 
of testing and curriculum specialists, school administrators, teachers and parents^ 
was formed and invited publishers to make presentations. No formal pre-set criteria 
exist, but the committee examined test specimens to assure that test configuration 
was tied to curriculum objectives and bias had been eliminated. Once the test had 
been selected, the price was negotiated. If a satisfactory arrangement had not been 
reached, a second choice would have been made. 

TECHNICAL INFORMATION 

Dade County does not presently have any district-wide, district-designed 
tests. The State Student Assessment is examined for validity, reliability and ex- 
clusion of the state level . 

ADMINISTRATION OF TESTS 

All students in all schools are tested within the students' schools. 

Tests are retained at the Testing Office, inventoried, and sent out to 
schools preceeding testing. Principals must verify in writing that the tests have 
secured while in the schools and that all tests have been returned. 

The Testing Office holds workshops for school testing chairpersons who 
in turn provide in-service training for teachers on test administration. They are 
also provided manuals. 

Students who are "educable mentally retarded", "trainable mentally re- 
tarded" "profoundly mentally retarded", "specific learning disabled", "emotionally 
handicapped and hearing impaired" are exempted from tests except by parental re- _ 
quest Braille and large print are available for vision-impaired. Oral testing is 
available to students in certain exceptional categories. Certain exceptional 
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students are allowed special testing conditions such as fl^^ible scheduling. No 
adaptations of the State Student Assessment Test are made/for limited or non-English 
proficient students. 

MANAGEMENT OF TEST DATA 

Test scores are recorded on the pupil data base system and are accessi- 
ble to schools through terminals in the schools. Indivi dual . 1 i sts , frequency 
distributions 5 and all summary 'data by test, grade^ level and school can be generated. 
Analyses by gender, race and languag-e can also be produced. 

A school profile report with all te^t scores from the state assessment 
program and Stanford Tests is sent to each prJiricipal. This report provides a^ 
capsule look at many variables within each s'chool . All area and di stj^t-^stliool s 
receive aggregate reports of schools in their areas and djjjLrJ^G-fe'Srr^'TV^ data 
by school, grade, and comparative data are provj^deji-^^^ and 
Board of Education • The-se reports are also pfovTded to schooinrrrd -the media and 
are available to the 'public through the Public Information Office. 

Workshops are given to assist teachers on test result interpretation 
but limited staff resources preclude regularity. Schools have been advised that 
testing staff is available on invitation to fiold workshops. The state provides 
regional training and information dissemination to test chairpersons (principals 
and guidance counselors) who are responsible for relaying information to faculty. . 

Parent reports on test scores are sent out, timed when possible to 
permit consultation with schools. Workshops on test result interpretation are 
held for PTAs and Parent Advisory Councils. The district hopes to put out a more 
complete parent report on test result interpretation. 

Student records show results from each test tak.en including Stanines, 
percentiles, scaled scores' and new scores. School personnel, parents and students 
at the age of majority have access to records, * 

Computer tapes/images of test results are maintained a minimum of five 
years. Hard copy reports are part of school system records. 

The Education Audits Department includes testing and responsibility for 
test administration in addition to research, and evaluation functions. Curriculum 
and Instruction is located in a separate department but a team work concept is em- 
ployed with respect to relationships between testing and cumculum. 

TEST RESULTS 

Students who fail tests or ^eore below minimally acceptable levels 
primarily receive remedial assistance in regular classrooms but may also be ptaced 
in remedial classes based on their failure to demonstrate mastery of objectives. 
The district also uses summer school., tutorial assistance, skills labs and numerous 
methods of remedial work defined by s'tate regulations. 

Mastery of all objectives on Part I of the State Student Assessment Test 
must be considered prior to promotion from grades 3, 5, and 8 by state law. Mastery 
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rtciiiEVEiihNr rtSTs (uade couniy) 



orade 
Tested 


Name? tif 
Tent 


Designed 
by Whom 


Ar'ons 
T(";(.ed 


Metric 
or UM* 


When 
Given 


NRT/ 
CRT 


Forms 
Used 


Norms / 
Used 


General Purposes 


K 


Metropol i tan 
Readiness Test 


Psych Corp 


Battery 


Raw Scores 


Fall 


NRT 


Form A 


Fall: 1st 

Grade, 

National 


For early admissign to first 
grnde 


K 


Cooperative 
Pre- School 
Inventory 


Add 1 son- 
Wesley 


Readiness 
Childhood 
Skills 


Rav/ Scores 


Fall 


NRT 


Doth 
Spanish and 
Engl i sh 


Fall 

National 


To assess readiness for early ad- 
mission to kindprqarten;c lassi f i - 
cation of students into instruc- 



SE-SAT 



1-a 



Stanford 

Achievement 

Test 



9, 10, Tost of 
12 Acadetalc 
Skills; 



MO 



Cal I forn ia 

Achievement 

Test 



Psych Corp 



Psych 
Corp 



Psych 
Corp 



CTB 
McGraw-Mill 



Past experi- Stanine Late 
ence, Percfinti les Apri 1 

Listening, Conmuni- 

cations, Letters, 

Sounds Oral Compre- ^ 
hens ion. Math Con- 
cepts 



NRT 



Complete Battery 
for al 1 grades 
including Science 
and Social Studies 



Complete Battery 
including Science 
and Social Studies 

Reading Comprehen- 
sion, Math Computa- 
tion 



Percentiles, 
Sta nines 



Late 
April 



NRT 



Percentiles, 9, 10, 



NRT 



S tani nes 



Nonnal 
Curve 

Equivalent 



April; 
12 - Fall 



Fall and NRT 
Spring 



Both 
Forms 



National 



Fonns E 
F (Half 
schools E, 
Half 
school s 
F) 



Ma tiona 1 



National 



National 



tional strategies. 

Part of cotinty-v/ide testing program 
v/hich : 

1, Provides parents with means to 
examine achievement levels 

2, Provides in.onnation by grade' 
for curriculum modification 

3, Provides information by grade 
on achievement progress 



Title I and state compensatory 
education evaluation 



FRir 
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MINIMUM COilPETENCY TESTS (DADE COUNTY) 



'Urade 
Tested 



Name of 
Test 



3, 5, State Student 
8, 10 Assessment 
Test, Part 
. I 



10 State Student 
Assessment Test 
Part J! 



Des igned 
by Whom 



S ta t e 



State 



Areas 
Icsted 



Reading 
Wri ting 
Math 



ConiTiunl ca- 
tion^ Skills 
and^lath 



Metric 
or UM* 



When 
Given 



NRT/" 
CRT 



Tonus 
Used 



Norms 
Used 



Percentile, 3, 5, 0- CRT 
Mastery Oct 

10 April 



Pass/Fail 



General Pur poses 



To provide parents with means 
to examine achievement levels; 

To provide information for cur- 
riculum modi fi cat ion; 

To provide ' information by grade 
on achievement progress. 

Consideration of mastery must 
be noted prior to promotion from 
grades 3, 5, 8. 

Mastery on Par' I must be 
achieved prio .ito graduation* 

To establish minimal compe- 
tency. May be repeated in sub- 
sequent grades until passed. 
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of Part I must be demonstrated prior to graduation. However, mastery may be demon- 
strated by means other than the test. A teacher may, for example, indicate that a 
student has demonstrated mastery. Part II of the State Student Assessment Test ts not 
yet a factor in graduation pending the Appeals Court determination in the Debra P v. 
Turlington and State of Florida Case. Suit was brought against the state for the use of 
minimum competency tests as a graduation requirement. Plaintiff contended that the 
test does not relate to the curriculum, violated the 14th amendment due process rights 
by failing to provide adequate notice and perpetuated the effects of racial discrimi- 
nation. The state is presently in the process of assembling materials to prove to the 
court that the skills tested have been taught. Another case, Love v. Turlington, 
attacks Part I of the State Student Assessment Test on the same grounds as the Debra P 
case. The final decision in the Debra P case is expected to set the precedent for the 
Love decision. 

The- state pays the costs of the State Student Assessment Test. 

For further information on Dade County's Testing Program, please contact: 

Dr. Gene Barlow 

Office of Education Audit 

Room 713 „ ' 

1410 TTE'Second Avenue 

Miami, FL 33132 

Phone: (305) 350-3447 
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DALLAS 

T-he district uses standardized commercially-published achievement tests, 
district-designed achievement tests and both state and district-designed minimum 
competency tests . 

PURPOSES OF TESTING 
— 

Elementary and secondary NRTs are used: 
0 for program evaluation 

J for diagnosis of individual student . strengths/weaknesses 

9 to place students in remedial classes (Title I, compensatory programs, 

0 to assess the need for curriculum revision 

0 to measure district-wide achievement progress 

f • 

CRTs are used at elementary and secondary levels: 
8 for placement of students 

d for diagnosis, of individual student strengths/weaknesses 

6 to assess the need for curriculum revision 

8 to measure district-wide achievement - ^ 

^CRT test results are one of a number of criteria used to determine promotion. They 
are also used to some extent, in program evaluation. 

V 

The DalTas tests ar^ referenced against the curriculum. Using^an inter- 
departmental approach; the district plans on an annual basis to develop district 
performance objectives. -Each school must also develop a school improvement plan 
within the framework of the district plan. The plan is anchored to test scores. 
Assessment. kits are available to teachers for instructional purposes. 

SELECTION OF TESTS 

When t£Sts are to be selected, a test committee from the Testing and Infor-* 
mation Systems Department does the footwork. Specimen sets from publishers are - 
reviewed and the selection narrowed. The committee then invites Instruction and Cur- 
riculum personnel and subdistrict officials for content review. State law mandates 
bids but the selection process usually yields a sole bid. 

The district generates its own test items by cleaning up items from instruc- 
tional tests and assembling teachers to develop specifications and draft items. 

TECHNICAL INFORMATION % 

All district-designed tests are field-tested in four or five schools prior 
to implementation. Item analysis are conducted to assure reliability and to preclude 
racial and cultural bias. The test development group is multi-ethnic and also'works 
' with the Bilingual Department. Validity is based on content. 
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ADMINISTRATION OF TESTS 



Presently, all tests are given to all students in all schools (or specified 
subpopul ations ) and all testing is presently conducted within the student's school.- 

All tests are retained by Testing an\i Information Systems. Test booklets 
are numbered and an inventory control process has been instituted. Responsibility is 
delegated from testing to Building /Test Coordinators to teachers." When the BOAT 1s 
administered, personnel from Testing observe. 

Testing and Information Systems trains principals and Building Te^t Coor- 
dinators on test procedures. They, in turn, are responsible for faculty in-service 
training. In addition. Testing conducts in-service training for faculty in 60-65 
schools per year. 

Any limited English proficient (LEP) student enrolled less than seven months 
in an English curriculum is exempt from tests. Non-English Proficient (NEP) Spanish 
are tested with the C.T.B.S. Espanol . The Texas Assessment of Basic Skills is admin- 
istered to all students in English but instructions may be translated. 

Special education students are pnly tested if they have been mainstreamed 
in a particular subject area and are tested on that area only. The I.T.B.S. is 
available in Braille. The district is working on large print for vision-impaired and 
other adaptations for handicapped students. Some tests are administered in Sign at 
centers 1^or the hearing impaired. 

MANAGEMENT OF TEST DATA , 

Dallas creates a static data .base with all test data and a dynamic data 
base which contains student enrollment data. The two bases can be accessed and 
cross-referenced by student identification numbers. 

The data base is used to generate level of testing recommended for each 
student. The .data are aggregated to produce summary statistics by grade, school and . 
by district. Class lists, individual teacher reports and cumulative record labels are 
also generated. The base allows for analysis of test results by school and race. 
Language is implicit because of tests given in Spanish. The base allows for analysis 
by gender but it is not done. Analysis by SES is not possible except through school^ 
lunch data. 

Each teacher receives an Individual Teacher Report with all test results 
and overall results'. Class lists are provided to principals and administrators. Ag- 
gregate reports are presented to the Board of Education, Superintendent and adminis- 
trative staff, .^'^^ ^ \ 

^eachers 4re given assistance on test result interpretation during ijn-s*ervic:e 
training. Parents ar^^iven written reports of tes.t results which, on the NRtis, 
shows a graphic depiction. of Stanines, and on CRTs, defines if student met-mastery of 
objectives. Policy requires parent-teacher conferences to discuss test results but 
implementation is not consistent. - \ • ' 



ACIIltVtNENI TESTS (DALLAS) 



""Uratfc 
Tested 



3-8 



Ntime of 
Test 



itetropol i tan 

Readiness 

Test 



1. 2 ITDS 



ITDS 



1-8 CTBS 

Espanol 

1, 2, Assessment 
3 of Baseline 

Curr leu lum 



9-11 TAP 



K-12 Language 

Assessment Scales 



OesigneT" 
by Whom _ 



Areas 
Tested 



Metric 
or UM* 



When 
Given 



NRT/ 
CRT 



Forms 
Used 



Norms 
Used 



Gene r al Pur poses ^ 



Psych Corp Auditory, Percentile 

Visual, Language, ' Stanine 
Pre-reading, Quan- 
titive 



Riverside 
Publishing 



CTB/McGraw- 
Hill 

District 



Riverside 



L inguame- 
tr ics 



\'lor6 Analysis, 
Math 

Math, Voca- 
bulary, Reading, 
Language 



centile 
Stanine 



Reading, Lan- 
guage Arts, Math 



Reading , 
Math, Written Ex- 
pression, Using 
Sources, Social 
Science, Science 



Mastery 
by objec- 
tive, raw 
score 

Standard 
Score, per- 
centile 
Stanine 



April 



Vocabulary, Grade equiv- April 
Reading, Spelling, alent, per- 



April 



Math, Reading Raw Score April 



April 



NRT 

NRT 

NRT 

NRT 
CRT 



Form P 



Form 7 



Form 8 



Form S 



Forms A 
and B 



National 



National 
and large 
city 



deriving 
local norms 



ALL NRTs: 
To provide feedback to teacher 
for instruction in following 
year, individual diagnosis, 
accountability measures for 
planning and instruction 



Children" in Spanish Instruc- 
tional programs. 



Same as for NRTs 
Will be introduced 
next year 



in 4, 5f 6 



Mandated for all NEP students 
placement and assessment 
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MINIMUM COMPETENCY lESTS (DALLAS) 



JTested 
3,5 



9^ 



Nanio of 

Tn3(cis Assess- 
ment 



Tpxas Asspss- 
mf nt 



by Whom 
State 



State 



BASic Objectives 
Assessment T<*sf 



ni'Jtrlct 



Areas 
Tested 



Metric 
or UM* 



When 
Given 



NRf/ 
CRT 



Hath, Reading, M(j5tery or Feb 
*Wri ting non-mastery, 

raw score 

total 



^ Math , Reading, 
Wri ting 



Tunctional 
1 1 teracy appl i cation 
of bas ic ski 1 1 s , cuts 
across all subject 
areas--11fe skills 



Raw. scores 
oy perform- 
ance area 
and total 
score per- 
cent 
correct 



Feb 



CRT 



CRT 



8-11 
May 



CRT 



Fornis 
JJs ed ; 

New each 
year 



New each 
year 



Norms 
Used 



Five pnral- 
lei foniis 



G e ne r a 1 Pu rp o s e s 



Mandated by state legislature 
to assess level of basic skills' 
statewide 



Exit level test. Once passed, 
must not be retaken. Tenth 
and 11th graders will retake 
this year, 12th next year. 
Legislature wishes to determine 
how many have mastered objbc^ 
tives ' 
\ 



9-1? 



Consumeri sm. 
Government, Home, 
Medical , Connnunl ty , 
employment, informa- 
tion sources 



12 

April 



CRT 



Five paral- 
lel forms 



Working toward policy which 
states student ^must meet a func- 
tional literacy requirement. 
^Eighth graders who do not pass 
VeiaJee at 9th-12th until thSy 
pass. Graduation requirement 
* effective 1983 



The computer generated labels for each test with test results are placed 
on student cumulative records to which teachers, instructional personnel, parents 
and guardians have access. A microfiche of test results is provided to subdistrict 
offices to which school officials and parents have access. Aggregate statistics -and 
test scores and norms for all students are microfiched and kept indefinitely. 

The Departments of Research and Evaluation are in the same division and use 
systemwide test data extensively for. program evaluations, etc. Curriculum and 
Instruction is'a separate division although a sharing process for instruction and 
accountability purposes exists. Testing and Information Systems administers the 
testing program* 

TEST RESULTS 

The district does not operate programs outside of regular classroom instruc- 
tion to prepare students for tests. However, Testing and Information Systems has 
developed a skit which shows students how :to take tests. Personnel then solicit feed- 
back from students. ^ The sk1t is done in schools and at PTA meetings. 

The standards for passing minimum competency tests (BOAT) are set through 
\the reliability and validity studies. The passing Qriteria has been set at 87 out of 
'l25 items on the total test or 70%. \ 

Students who do not pass the test in the 8th grade may retake It each year 
in May until they pass. If students have not passed by 11th grade, It Is recommended v., 
that they take a functional literacy course offered In the school. The BOAT is given 
as the final exam of this course. Students who do not take this option may continue 
to retake the test. 

Except for some compensatory education materials provided in the past by . 
the state, the district pays for all remedieQ work which Includes assistance In 
regular classroom, remedial courses,, a drop-iV^rogram after school for potential 
elementary retalnees , summer school* for remedial work and ret.^.lnees , tutorial work 
and skills lab. 

Test scores are a factor in decisions on promotion and remedial placement 
but other factors such as academic progress and judgement of teachers, principals 
and pupil personnel committees who deal with NEP students and retainees are considered. 

Test results are not presently a factor in decisions on graduation but, 
as of 1983, stu^en^ must pass the BOAT in order to graduate even if all other 
requirements have been met. Special diplomas will not be awarded to those who do 
not pass the test but they will be permitted to retake the test after leaving school 
at a Testing Center which is being established. 

The district pays the entire cost of the program with the exception of 
a $2 per child allotment from the state for bilingual testing. The TexaS' Assessment 
of Proficiency is paid for by the state but the district pays $1000 per year for 
the computer taped test results. 

For further information on the Dallas Testing Program, contaGt: 
Dr. LaVor Lym 

Dallas Independent^chool District 
(Box 150) 3700 Ross Avenue 
Dallas, TX 75204 (Phone: 214/324-I532: ; 




r DENVER 

The district uses standardized achievement tests published by a commercial . 
testing services, and district-designed achievement and minimum competency tests. \ 

PURPOSES OF TESTING '/ 

At the elejnentdry and secondary levels, NRTs are us^ed for: 

6 program evaluation 
% placement of students 

9 diagnosis of individual student strengths/weaknesses 

e assessment of the need for curriculum revision 

% measurement of district wide achievement progress / 

CRTs at the elementary and secondary levels are used for: 



©placement of students 
Q diagnosis of individual student strengths/weaknesses 
3 assessment of the need for curriculum revision 

Both NRTs and CRTs at elementary and secondary levels are/ a factor in decisions to 
place students in remedial classes. The results are alsgi used in the evaluation of 
federal programs. ' ■ 

The results of tests are examined both at th^ district and school levels 
by the Assistant Superintendents for elementary and secondary education, the 
Executi.ve Director of Curriculum and academic supervi/sors . Changes perceived neces- 
sary are discussed with principals or supervisors of academic disciplines and 
curriculum modification is made on the b^sis of these discussions. The tepts are 
referenced against the curriculum. / 

SELECTION OF TESTS 

! , When tests are to be selected, an ad hoc committee consisting .of teachelcs, 
principals', academic supervisors and representatives from the testing office is ap- 
pointed. The district has no pre-set criteria for selecting tests. The committee 
reviews test specimens and invites publis.hers\to make presentations about their 
instruments. Small sample field te:ts are conducted before the. final decisioH on 
an instrument is made. • 

When tire district designs its own tests, items are constructed by a com- 
mittee of teachers, academic supervisors and test specialists and are also field \ 
tested. 

TECHNICAL INFORMATION 

Reliability of district-designed tests is determined through test-retest, 
■ . internal consistency measures, and Kuder-Richardson formulae. Content validity is 
determined by committees which develop the items and are expert judges in various 
academic fields. The test development committees also conduct item scrutiny to 
assure that cultural, racial and gendfe.r bias have been precluded. 
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ADMINISTRATION OF TESTS 



All students in all schools are tested* in the students' schools. The tests 
are numbered and checked out to principals ^by the testing o.ffice. The principals 
must assure that all tests are returned. Training on testing procedure is provided 
at the request of teachers and principals. 

\ Special education students are not required to take the Proficiency and 

Revrew test because they may receive a work-study diploma. If they desire a Denver 
high)school diploma, they must pass the test. No other students are exempted. 
Braille and large-print tests are available for blind and vision-impaired students, 
Test^ ma^ be administered orally to orthopedi cally haTidicapped students at the 
discretion of teach6^rs. All tests must be taken in English.^ Students with limited 
English proficiency recei've assistance when possible in preparing for tests. Reme- j 
dial classes are availalDle for all students failingVny part of the test, / 

MANAGEMENT OB^TEST DATA ' 4 

xiie district maintaijis a centralized test data base for all centrally 
a^drn-inistrcTted tests and a separate centralized student data base. The test dat& ; 
base TO^ltains individual student res ults as well as school summary data. (Il>^s, 
school dnd^-'dls4:ficT'~TLmimaries' i^ncnTrdurt'~s~riTr'a^ialy^es for e^ch pupil arVgen 
erated. The base anows for analyses by school but no gender, race; langi/age or 
SES. . ' ' . 

Central office representatives provide assistance with test result inter-j 
pretation to testing representatives from each sc,hool who in turn advise faculty. I 
members. Parents are provided assistance in conferences wi/th teachers. WrlTE^n-- ; 
reports are sent home to parents at the discretion of indi/Vidual schools. 

Studeftt records show^test raw scores, stanines^' percentiles and grade 
equivalents. Teachers, students ,_ pa^^ents^^^^^ counselors have access 

"to the records . ' > ' 

Test data are mafn^a+flTd by year, by school, and by student. Individual 
students. test results can 6e obtained by accessing each year's results. 

The ResearcH^Director in the district reports to the Executive Director >^ 
for Curriculum. The Offite of Testing is responsible for test administration. 

TEST RESULTS 

The standards for passing m'inimum-competency tests were set by a commit- 
tee comprised of teachers, principals, academic supervisors and testing office 
personnel The/committee examined the distribution of scores the first several 
times the test was used and selected a cutoff point. Jhe cutoff score has increased 
several points since the test was first instituted in 1950. Students must respond 
correctly to 32 out of fifty items on each subtest. Between 97% and 99% of students 
pass the test by the end of 12th grade. Students must pass the test to graduate 
even if all other requi rements have been satisfied. Those who 'never .pass are awarded 
a Certificate of Attendance. 




ACHIEVEMENT TESTS (DENVER) 



Tc'Ued 
K 



Nome of 
Test 



Clyiner-BaVrett 
Test 



CTBS 



CTBS 1, 

Check Point 
CTBS 



Ues igned 
J)y Whom 

Ginn and 
Company 



CTB/McGraw- 
Hill 



CTB/McGraw- 
Hfll 



District 



Areas 
Tested 



Me t ri c 
or L;-!* 



WRen 
Given 



Visual and Raw Score 

Auditory Dis- 
crimination 



Spring. 




/ 



ftath, Language, Percentile Spring 
Reading 



Math, Language, Percentile Spring 
Reading ^ 

Raw ^Stfore Spring 

Percentile Spring 

Spring 

Raw/Score Spring 

Percentile Winter 



Spring 



CRT 



NRT 



NRT 



NRT 

CRT 
NRT 

NRT 
CRT 
HRT 



Winter NRT 
Winter NRT 



NRT 



Forms 
Used 



Norms 
Used 



Gen eral Purposes 



National 
provided by pub- 
lisher 



Level 1 Nfiitlonal 

provijJed by pub- 
lisher 

Level 2 



Level 3 

Level 3 

Level 4 

Level 4 



Audio and visual discrimina- 
tion Readiness for 1st grade 



Program evaluation, placement 
of students, curriculum revi- 
sion to measure district wide 
achievement progress dlac^nosis 
of student strengths/weaknesses 



Placement of students, diagnosis 
of student^trrengths/weakjiesses , 
curriculum revision 



L. 
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COMPETENCY TEST (DENVER) 



rest 



Designed 
J5y_ Wfiom 



Areas . 
Tested 



Metr Ic 
or UM* 



When 
Given 



NRT/ 
CRT 



Forms 
Used 



Norms 
Used 



Genera l Purpo ses 



9,1 10, Proficiency and 
Hi & Review Test 
12 



District Math, Reading, t^aw Score 

^^^Language 



Fall 

Winter 

Spring 



CRT 



Three forms 
used 



For graduation 



ERIC 



-68- 



Remedial assistance is provi^ded in the regular classroom, in remedial 
courses, in before/after school drop-in p/ograms, in summer school, tutorial, and 
^n skills labs. The forms of remedial assistance-* availabl e are determined by 
individual schools. Remedial courses are optional . ^ Al 1 costs of remedial work 
are borne fay. the district. 

In addition to test scores, subject grades and teacher recommendations 
are factors in decisions to promote students or to recommend remedial work. 

},K The district has specified its own minimum achievement levels. No legal 

aCtiWs have been taken against the district for using minimum competency or other 
te^s . The district pays the entire cost of its testing program. 

For further infcfrmation on Denver's student assessment program,, contact : 

y Dr. Barry Beal 
/ Denver Pub/ic Schools ^ 
{ 3800 York Street 
Denver, CO 80205 

^ r Phone: (303) 837-1000 ^ 
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DETROIT 



The district uses standardized aGhievement tests published by a commercia) 
testing service, district-designed achievement . tests and both state and district- 
designed minimum competency tests. 

PURPOSES OF TESTING 

Both NRTs and CRTs are used at elementary and secondary levels: 

fi for program evaluation 

0 for diagnosis of individual student strengths/weaknesses 

• to place students in remedial classes 

9 to assess the need -^or curriculum revision 

• to measure distriev v,:de achievement progress 

NRTs and CRTs are used at the secondary level for placement of students; test results 
are also used in the evaluation of federal programs. 

The criterion-referenced tests used in the high schools, including the 
proficiency examination and the Ninth Grade Communication Skills Test as well as 
criterion referenced achievement tests now being developed for Grades 1-8, are all 
referenced agains't the curriculum. * Curriculum personnel examine test results and 
make any necessary curriculum modifications. .Curriculum modifications can occur at 
the district, region or school level. 

SELECTION OF TESTS 

The district has no standing test review committee. Research Department 
personnel review tests on the market and tests in use in .the district. The Research 
Department tentatively selects tests with the aid of curriculum personnel , principal s , 
teafchers, counselors, etc. Based on feedback, a test selection is made and sent to 
tXe superintendent to approval. The commercial tests are not piloted prior to im- / 
/^lamentation. 

The district has no pre-set criteria for selecting tests.. Applicability 
to the curriculum, manageability and exclusion of racial , cultural and gender bias are 
carefulli considered. • There is a standing committee in the Research Department which 
reviews Commercial tests for bias. The district has refused tests and has had test 
items changed when bia^-was-^detected . When the tests are reviewed, publishers are in- 
vited to make presentations, proposals, and bids in a comp.etitive process before a / 
final decision is made. 

The district, however, is not satisfied usifig only commercial tests and is 
currently devel/oping its own achievement testes. Test' development is an interactive 
process between research and curriculum personnel. Initially, personnel from these 
departments ahd community members meet to determine ^.bi^ch academic competencies should 
be covered. Research personnel then 'write objectivp' which are verified by curriculum 
personnel. Once the objectives have been approved,/ the Research Department develops 
test specifications which, again, must be approved/by curriculum personnel. Test 
items are then written by* teachers with appropriate skills who are paid for writing 

test items. i ' I - 

/ 
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In addition to assuring that tests have curriculum, content, and construct 
validity, the test deve-1 oprpent process also leads to a sense of program ownership 
and commitment of the personnel involved in the process^ 

TECHNICAL INFORMATION ' _ 

All district-designed tests are field , tested with matrix sampling. Relia- 
bility is determined .with Ra^ch statistical models. Validity is assured through 
the test development process described abov... 

Methods used by the district to preclude cultural, racial and gender bias 
from test items duri ng ,devel opment are based on a monograph entitled "Guidelines for 
Reducing Discriminatory Testing," written by Dr. Romeria" Tidwel 1 . (Dr. TidwelT is 
a member of the faculty at UCLA, Department of Education, and an associate of the 
Los Angeles based Instruct ional Object ives E^xchange run by Dr. James Popham). 

The district has also developed its own additional guidel ines . Local 
committees consisting of teachers, administrators, local college people and, community 
members meet to review tests and determine if any items are objectionable. 

ADMINISTRATION OF TESTS , ■ " 

All students in each, grade, except students who have been in the country 
for less than one year, are tested. Testing is conducted in the students* schools. 
'The High School Proficiency Examination \is sent „to schools just prior to administration 
and picked up immediately afterwards. A\l other tests are secured in locked areas in 
the school s . \ 

The in-service staff of the Research Department conducts on-going workshops 
on test administration procedures and interpretation of test results for test coor-' 
dinators and teachers. , ' . 

Special education students may or may not elect to take the High School . 
Proficiency Examination. A modified version is available for special 'education stu- 
dents. However, those who pass the modified version do not receive "endorsed" diplo- 
mas which state that students have achieved minimum skills in reading, writing and 
mathematics. \ 

Braill.e and large print versions are available for vision-impaired students, 
Tests may be administered orally in limited instances to orthopedical ly handicapped 
students. 



NEP or LEP students wh9 have been 
be eaampted for the proficiency examination 
be pas.sed i n Engl i sh . 

MANAGEMENT OF TEST DATA 



in the country for less than one year may 
at the request of a parent. The test'musf 



The district' s/ data bases are in a state of flux. Results for the 
California Achievement tests are maintained on an item by item basis for each student. 
The district is developing a data base whic^h will contain all. NRT and CRT data for 



ERJC 



-71- 



ACHIEVEMENT TESTS (DETROIT) 



Tested 



Pre-K 



N.UMG of 
I on I 



Cooporative Pre- 
School Inventory 



Cal i forn la 

Achievement 

Test 



1-8 CaUfornia 
A 11 Achievement 
Test 



Oes igned 
by Whom 



Areas 
tested 



Addison- 
Ws-'sl-ey 



CTB McGraw- 
Hill 



CTB McGraw- 
Hill 



Me t r 1 c 
or UM* 



When 
Given 



Total 'Inven- 
tory 1 



Total Bpttery 



I 

Reading J 
Mat^^" 1 



April 



Number of 
questions 
passed 

RS, Scale 
score per- 
centile 
Stanine 



Grade equiv. April 
percentile 
Stani ne 
raw score 
scale score 



NRrT" 
CRT 



Sept/May NRT 
Oct/May 



NRT 



NRT 



Forms 
Used 



Norms 
Used 



General Pu rposes _ 



National Title I pre-school ; pre/post 

test for Head Start 



Form C National Title I Kindergarten evalua- 

tion 



Form C National General assessment program 

Evaluation of Title I 



9, 10, California 
12 Achievemont, 
TeU 

8 Alqehra, Pro- 
Alqolira, and 
Go 1 10 rat Math 
Test 

9 Communications 
Skills Test 



M, 7 
10 



Michigan Edu- 
cational 
Assessment 
Program 



CTO McGraw- 
Hill 



District 



District 



State 



Reading 
Math 



Math 



Reading 
Writing 
Study Skills 



Number of 
questions 
passed 



Pe.rcent 
correct 



Nov 
April- 



March 



Oct 
April 



NRT 



CRT/ 



CRT 



Reading 
Math 



Mh N I M U M. COMPETENCY 

CRT 



Number of 
objectives 
achieved/ 
not 

achieved 



Sept 
Oct 



Form C National Bilingual and Title I assess- 

ment 



To place students in 9th grade 
Math courses / 

■/ ' 

Pre-Post test of language 
arts program 



State minimum competency test 
for internal evaluation and 
state-wide comparison Diagnos- 
tic, no pass/fail records 



8 High School Pro- District 

ficiency Exam - 
Prel iminary Ed I - 
tion 

10, 11, High School District 
12 Proficiency 
Exam 




Reading 
Writing 
Math 



Reading, 
Writing, 
Math 



Percent 
1 correct 



dumber of 
Objectives 
passed/ not 
passed 



Oct 



Dec 



CRT 



CRT 
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Three forms — - 



Diagnostic, no pass/fail 
records 



To provide endorsement for 
graduation. Student must 
only pass once and only re- 
take parts not passed. 



/ 



t 



each student. Currently, the student, and test data bases are separate.. 

The existing test data base generates class lists, frequency distributions, 
summary statistics, item analyses ,' and reports which are sent to parents and students. 
The data base allows for analyses by grade and gender. . ^ 

At the end of • the year, a summary of achieVement test scores is published 
for ttte-ptibl ic, the media, the Board of Education, superintendent, regional and school 
^administrators, and curriculum personnel. Teachers, principals', and administrators^ 
also receive additional achievement data and reports during the ^ear. Data summarized 
by school and district hav^ been maintained for more then twenty' years . 

Parents receive 'reports with individual results from the'^oficiency exami- 
nation and 'Cal ifornia Achievement Tests. The reports, contain simple^anguage explain- 
ing the results and urge 



parents to contact schools for additional infomation 



Gummed "labels are also generated for student records. The labels frorn^tjie 
Proficienefy Examination show the number of questions answered correctly in each area>. 
the percent of the tota.l represented by the cqrrect answers and a pass/no pass 
' notation. The labels for the California Achievement Tests show raw score, number of 
questions on tests, niimber of questions attempted, and number answered correctly as 
well as all metrics reported. Teachers and counselors, as well as students and parents, 
have access to these records. The Reseaich Department and CurricuT'um Department are 
^ ^separate units |)ut arejocated in the same bu.ildtng and work together, conti nuously . 
'The Research Department is in charge of test administration. 

TEST RESULTS 

\ , ' 

\ . The standa^rds for passing the High School froficiency Examination were deter- 
mined by researc-h 'anjl curriculum personnel after the\test was piloted and the results 
examined. Provisi«ffis were made to permit modification of the standard if necessary. 
Currently students must achieve 70% correct in ^ reading and writing and 65% correct in 
math „t Q_pass . ^ i ^' I 

Remedial work is mandatory for studepts who !fail any. part of the proficiency 
examination. Remedial work may.' take the form b;f assistance i.n.^the regular classroom, 
enrollment in remedial courses, summer school , /tutorial assistance or skills labs. ^ 

Students who pass the proficiency exami nation rec.eive endorsed .diplomas . / 
Students who do not pass after .repeated attempts\ graduate w'ith unendorsed diplomas.. 
. Students may return as postgraduates to take the\test if they so desire. ^ 

Test scores are not the only basis for promoting a student or recommending 
remedial work (ex-cept with regard to the profiqiency examination). Other factors such ^ 
as teacher judgement, ' cl assrobm grades, student malturity, etc., are als,o considered. 

< The district' pavys for the entire student assessment program except for costs 
•associated with the Michigan Education Assessment Program and special project testing. 



V 
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For further information 'about the Detroit student assessment .'^program 
contact: > <^ ^ 

'Dr. Keith Stockwell ■ 
. Detroit- Public Schools . * . 

- , 5057 Woodward, Room 1224 
Detroit, MI 48202 . 

,;\ Phone: ^(313)' 494-1555 
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LONG BEACH 



^ The district uses onb' standardized tests published by commercial testing 

services. The California Achievement Test also serves as the district's minimum 
competency test. ^ 

PURPOSES OF TESTING . '-^^^ 

The district's achievement tests are used at the elementary and secondary 
levels: ' • ■ ' ■ ' ■ . ' 



I for program evaluation ' : • 

-• for-placement of students^ 

• for diagnoses of individual student and stren-gths/weakness-es 
.• to assess the need for curriculum revision 

• to measure district-wide achievement progress 



The results are also used in the evaluation of federal programs. 

The tests are referenced against the curriculum. Item analyses by. skill 
area for each student and each test are conducted. If weaknesses across the board 
are found in specific skill areas, curriculum modifications are made. 



SELECTION- OF TESTS / 

The district has no standing test review committe,e. The district-wide 
achievement te^t was sfel.ected by an ad hoc committee composed of teachers, counsel- 
ors and research personnel. The.minimum competency test was determined by a com- 
mittee consisting of research office personnel, subject matter specialists (Director 
of curriculum. Assistant Superintendent of Elementary Instruction and the Assistant 
Superintendent of Secondary Instruction), lay people, community representatives-, 
teaeiler representatives .and counselors. 

I The district maintains a test catalogue file from t .-^ major publisl.ars 
whidh is updated annually. District personnel attend workshops conducted by pub- 
lishers and also invite them to make presentations. Three .or four tests are always 
piUted in six or seven, schools to determine the relationship to the curriculum 
prifar to final selection and implementation. 

TjOHNICAL INFORMATION . 

I The district carefully examines publishers data with regard to reliability,- 

vailidity and exclusion of bias. 

ADMINISTRATION OF TESTS 

State tests are given to a M students at designated grade level with matrix 
simpling in reading, language^ spelling and math. As a result of matrix sampling, 
student results are not possible, the results of the State testing program are re- ■ 
Jorted by school average and by district average. There scores may be converted to 
School and district percentil e which are re-computed annual ly . 




/ 
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The locpl testing program uses norm referenced tests 
schools are tested in selected grades. 



All p.upils in all 



^ ' At the elementary level (k-5), the tests are kept at the schqpl sites; At 
the" secondary 1 evel , the tests are kept at the central office, numbered, and pack- 
aged by number. Tests are sent to principals who must assure their security in the 
school and the return of the exact number of tests. Principals ma:^ _ del egate respon- 
sibility to counselors. Test key.s"are not sent to the schools. Te^ts are scored 
at data processing or in the central office. - 



Counselors in the school are responsible for in-service training on test 
procedure' as part of their job description. 

Some special education students are exempt from tests. Adaptations are^ 
made for blind and hard of tiearing students on an individual basis. Limited English 
proficient students are given practice achievement' tests to determine the lev4>'at 
which they^can be tested. State law, however mandates that the competency test be ' 
passed in English. 

MANAGEMENT OF TEST DATA 

Tne district maintains separate student and test data bases. The C.A.T. 
results are maintained on separate tapes. Test results are printed on labels which 
are attached to student cumulative records . The 1-abel s show scaled scores and per- 
centiles and,- where appropriate, if the student has met proficiency requirements . 
eounselors , principals, teachers and parents have access to the records. 



al Jd 



reports frequency, distributions , quartilesby raw score, 
percentiles and quartile^', student lists and item analyses for each 



The district 

scaWd scores, K^"^-"-' — — -.^ , - r- k 

test The data base allows for analys.es by school, gender, race and language, hach' 
time a test is given, a report on the standing of each school is given to principals 
subject matter consultants, administrators and the Superintendent 

The Testing. Of-fice provides written direction and memoranda on test result 
interpretation. Counselors are responsible for advising teachers , an^ parents 
receive ^ssitance during parent-teacher conferences. ■ 



Student 



The district has maintained test da,ta fey school and 
■by-student data have also been maintained but the duration 



distript 
is 



since 1950, 
unknown . 



\ 



acts in 



TEST 



Research and Testing are separate f„rom Ins-truction, Research and Jesting 
an advisory capacity to Instruction ai^nd is in charge of test adjn'i nistration , 

RESULTS • .• • : ■ ' " 



The norm-referenced test used by the district serves as_a measure of~eiL- 
cerence as well as a test for minimum competency. The test is first given a? a 
minimum 'competency test in the 8th grade and remedial work is automatic for those 
who doi not earn a scaled score of 510 or better in .reading comprehension, language 
expression and mathematics computation. Parents afe notified and a conference 
is set! up to review the student's scores. and item analyses. The best possible pro- 
gram fir the student with the school -is determined. Remedial packages are prepared 
for stiSdents' use in the classroom under supervision. In addition, students may 
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ACHIEVEMENT TESTS (LONG BEACIJ) . 



urade 
Tested 



Test 



8 
9 

10 



State Entry 
Level \ 



Cal ifornia 

Achievement 

Test 



California 

AchleveiPejtt 

Test 



Cal 1 fornia 

Achievement 

Test 



Designed , 
by Whom ^ 



Areas 
Tested 



Metric 
or UM* 



When . , NRT/ ' Forms ' ' Norms 
Given CRT Used Used 



State of 
California 



CTB McGraw- 
Mill 



CTB McGraw- 
Hill 



CTB McGraw- 

nni 



Itimediate 
recal 1 , fetter 
Recognition^ 
Auditory Dis- 
crimination, 
Visual Discrim- 
ination* 

Reading .Com- 
prehension, Total 
Language, Mathe- 
' nietics Computa- 
tion 

Reading, Lan- 
guage,, Spelling, 
Math 



Reading, Com- 
prehension, Lan- 
guage Expression* 
Math Computation ^ 

Reading, Lan- 
guage, Spelling, 
Math 



See last 
line . 



Percen- 
tiles, 
Standard 
Scores 



Percen- 
tiles, 
Standard 
Scores 



Sept 



April 



Oct 



April 
May 



April 
May 



NRT 

NRT 

NRT 
NRT 

NRT 



Fonn C National 



Forin C National 



Form C National 



Form C National 



Form 0 Na.tional 



General Purposes 



Readiness for. formal 
school ing 



All purposes cited on page 1 



Also used arT^Tinimum competency 
test 



Used for minimum competency \ 
requirements 

Used for minimum competency r^ 
quircments ^ , 



Used for minimum competency ^re- 
quirements 



/ 
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Long Beach - Achievement Tests Cont*d 



urade 


Name of 


Designed 


Areas 


Metric 


When 


mi/ 


Forms 


Norms 




Tested 


Test - 


by Whom 


Tested 


or UM* 


Given 


CRT 


Used 


II<;pH 


1 ' uciiera 1 1 urposes . 


11 


California 


CTB McGraw- 


Reading Compre- 


See last 


April 


NRT 


Form C 


National 


Used for miniiiium competency 




Achievement 


Hill 


hension, Lan- 


1 ine 


May , 








requirements 




Test 




guage Expres- 


















sion, M&th 




















Computation 














3, 6, 


Survey of 


State of 


Reading, Lan- 


.- 

Percent 


3 & 6: 


CRT 






State mandate 


12 


Basic Skills 


California 


guage, Spell- 


correct, 


April/ 








Matrix Sampling - no student 








\ ing, Math 


Standard 


May; 








data provided 










Scores 


12: Dec , 












\ 






and 




















Percen- 




















tiles, 


















based on 




















average 




















rpsu Its 




















for a 




















school 




















and/or a 








\ 




- 


\ 

r 




> 


district 










> 

\ > ■ ■ 
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enmll in remedial courses and summer, school', receive tutorial assistance and work 
in skills' la-trs". The district pays for all remedial work. 

Test scores are not a factor in , promotion decisions and other criteria ' 
are examined-faefore placing a student fo,r remedial work. Students must pass the ■■ 
minimum competency test to graduate even if all other requirements have been satis- 
fied. .By state law,' no docunlents except transcri pts- and letters of recommendation 
may be given to students wh o do not pass the minimum competency exam after repeated 
testing. , " : " , 

The district presently specifies minimum achievement levels and no legal 
actions have been taken against the district with regard to testing. 

The state furnishes the materials^ for its Survey of Basic Skills in 
gra^des 1, 3, 6 and 12 and the district does not pay the cost of tests given under 
state ,0;^edera 11 y funded programs. 

/ For further 'information on Long Beach's student assessment progre . 

contact: . " ' . ^ ' . 

Mr. James Edmonson / 
Director of Research and Evaluation- • . / 
Long Beach Unified School. System / - ' . 

701 Locust Avenue ' i ' 

- . Long Beach, CA 90813 • . 

Phone: (213) 435-9931 



• ,LOS ANGELES . ^ ' " . . M 

The district uses standardized achievement tests published by a com- 
mercial testing service and both district-des,igned cri terion-referenced achieve- 
ment and] minimunv competency tests. 

I . • ' ■ r 

PURPOSES QF TESTIil G 

NRTs are^used^at the elementary and secondary levels : 

I for program evaiu^tion ■ , , 

• to measure district-wide, achievement progress 

CRTs are used at both elementary and secondary levels: . - 

• for diagnosis of individual student strengths/weaknesses 

• to place stuclents in remedial classes, 

• to assess 'the need for curriculum" revision 

I • to measure district-wide achievement progress. 
'^^ fi to determine the need for teacher in-service training. 

They are also used at the elementary levelias one of jmany criteria in promotion decir 
sions. Both NRTs and CRT?. are used informklly in placement of students. Results '! 



are also used in the evaluation of fe'deral 



programs 



\ 



The test objectives in th? district's Survey of Essential Skills are based* 



s are tied to curriculum objectives. If 



^ on the district's skill continuum, so item^ — --. . 

scores in an area are particularly low, ttte, office of instruction works wi.th teachers' 
' to "improve in that area.. At the junior and senior high levels, remedial materials are. 
given to students where necessary after competency test results have been analyzed. , 
Only elementary tests are specifically referenced against the curriculum. • . 

SELECTION OF TESTS ■ ' • 

When tests are to be selected, area superintendents are asked to recommend 
pepple familiar with specific curriculum areas to act as test selection committees. 
The committees review test specimens supplied by publishers to ascertain their match 
to curriculum and give opinions about format and pos.sible bias. The tests- then go to 
the testing unit for technical review. Test selection criteria are presently being 

developed. ' . 

^ . \ 

When the district develops its own_ tests, items are generated within the 
■ district by curriculum specialis[ts, teachers", and others who have test writing skills, 

TECHNICAL INFORMATION - • ^ 

. The reliability of the elementary level Suryey of EssentialSkills was 
ascertained in studies performed by the Southwest Regional Lab. Reliability studies 
for junior and senior high competency tests were performed by'CTB McGraw-Hill. 
Reliability of • SHARP was measured with Cronbach's alpha coefficient and yielded co- 
efficients of, .94 (grade 8 and 12), and .95 (grade 10). On .-the^ TOPICS test, the 
criterion for an acceptable item was a biserial correlation of .30. This biserial 
correlation measured the relationship of. the pass/fail scot^es' of students on a partic- 
ular item with their total' scores on the test. ' 

• ' -80- 

er|c 



Although content validity was- assured on the TOPICS and SHARP test, 
product-moment correlations with APL and CTBS.were also generated. 



Attempts are made to preclude cultural, and racial bias from the initial 
construction of items. Subfijequently , item analyses are cond'v ted to deterniine if 
significant difft^rences e)^fst between groups in responses. 



ADMINISTRATION^Of TESTS ' " . > ' 

Essentially, all students in all schools are tested in the district-wide 
testing programs. All testing is conducted in the students' schools. 

Elementary and junior high tests are stored in the schools. The senior 
high competency tests are maintained in a central warehouse. Schools must request 
the number of forms required and all must be returned. The number of returned tests 
is determined by.yweight.- 



tion. 



Each year special traininlg is offered for all teachers on test administra- 
It is usually attended only by- new teachers, unl ess new tests are introduced. 



Special education studentk and those in non-diploma programs as well as 
very 1 im^ited Engl ish proficient students are exempt from NRTs. No adaptations 
are made for LEP or NEP students. High school .competency tests in Brail Ve -and largec^ 
print are available for the vision-impaired.' . p^re is also modification of questions 
not applicable to students with some\handicaps . Oral tests are given to those who 
cannot use their hands. State law requires that the senior high minimum competency 
test be passed in English. 



MANAGEMENT OF TEST DATA 



\ 



The district's test data base\ is fragmented. Testsj are machine scored 
and results maintained several , lo&ations . ' Test data from pne student may be in 
sever'al ^places . Summary^data school iby\school are maintained^' centrally. There 
is no^ relationship .between the test data base and the student data base. 

■ . ' • \; i ■ ' 

At the elementary level, average percent correct arid item by item per- 
cent of students with correct answer are reported. -At the junior and senior high 
level, the number and^percent of students in passing and failing ranges is reported. 
Only the elementary data base allows- for analyses by school , i gender , race and lan- 
guage status . \ - I 

Public reports are issued to all schools and offices as well as the 
Board of Education. 'Reports are sent to schools and personnel on students and 
schools within administrative units. The State Department of Education, receives 
reports on grades 6, 9,' 11 and. 12 as par^t of permanenl stratified sample. 

The test reports contain a^section on\*interpretation of results. Reports 
sent to schools are accompanied by memoranda on\interpretation. Teacher designated 
testing coordinators and area advisors /consul tants in administrative districts 
provide assistance to both teachers and parents X Parents are also given assistance 
on interpretation in individual conferences wi th Vparents of 5th, 9th and 11th grade 
students who have failed tests. Letters ate sent\to parents of all senior high . 
students advisiing of students* pass/fail status. \ 
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ACHIEVEMENT TESTS (LOS ANGELES) 



urade 
-Tested 



Ntinie of 
Test 



Designed 
by Whom 



Areas 
Tested 



Metric 
or UM* 



1-6 



3. 5. 

8 



Survey of Essential Southwest . 

RegioHal 
Lab based 
on LA USD 
SkUls Con- 
tinuum 
•* 

, CTB McGraw- 
Hill • 



Skills 

/ 

CTBS 



Reading, Math, Percent.. 
Language correct 



Reading, Math 



National 
Horn per- 
centiles 



When 


NRT/ 


Forms 


Given 


CRT 


Used 


April 


CRT 


One now. 


May 




new one in 






Spring will 


r 




al ternate 


May 


NRT 


Form S 



Norms 
Used 



General Purposes 



1-12. \:TbS 
1-6. 

1-6 

7 ' 



CTBS Espanol 



Survey .of Essen- 
tial Skills 



MINIMUM COMPETENCY TESTS 
.ALL INFORMATION SAME AS ABQVE ' 



Performance 
Assessment 
in. Reading 

,Asse^!5ment of 
Skills in com- 
putation 

Write Junloi^ 



L.A. Unified 
School Dis- 
trict 



10 



10 



10 



L.A. Unified 
School Dis- 
trict . : 

t. A. Unified 
School Dis- 
trict 



Reading 



Math 



English 



Raw Score Feb 
Mar 



Rsw 
Score 



Feb 
Mar 



CRT 



CRT 



Senior Assess- 
ment of Read- 
ing Performance 
,{ SHARP) 



Test of Perfdrtnanci? L.A. Unified 
in computational School Dis- 
Skills (TOPICS) 



Raw Score Feb, K^r CRT 
Reading • \^ Pass/Fall Feb, ^ar CRT 



Math 



Pass/ Fail 



Feb, Mar CRT 



Write Senior 



trict 

L.A. Unified 
School Dis- 
trict 



WritlngSkllls ^Wssfeai^^^^^ Feb, Mar CRT 



Forms A-, B, 
,and C 



Forms A, B,l 
and C 



Forms A, B,/ 
and C . 



Forms B,aC, 
D, E ^ 



Forms A, B 
and C 



Forms A, B 
and C 



To assess student progress 
in terms of mastery of es- 
sential skills 



To assess how pupils <vre 
progressing in relation to 
national peer group 

For Title revaluation 



For evaluation of Spanish 
bilingual programs 



To assess minimum competency 
skills. Students who fail 
have opportunity to retake in 
eth ?nd 9th. 



To assess a variety of life 
skills 



To assess a variety of life 
skills 



To assess a variety of life 
skills - 
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^ ■ . At the elementary level a printout of all test results- is attached to th= 
•student s record. .A label indicating pass/fail status is attached to secondary 
students records. Principals and teachers have access to elementary students 
records. Counselors and teachers upon request submitted to counselors have access 
to secondary students' reccrds. No^ longitudinal 'data can be maintained because of 
the fragmented nature of tiie\data. 

■ --' ^ i ■ ' ^ ' 

The Research and Evaluation Branch and the Instruction ('-urricul u-^^ • 
department are separate but Report [to the sa^.e superintendent. The Assisian- Dir-ci 
of Testing in the Research "and Evaluation Branch is in ch?rae test ad-ir.^striT*-:-- 

TEST RESULTS . * 

The standards for passing minimum con^petency tests were set by th° Super- 
intendents and the Research and Evaluation Branch. The standard is based on curriculi 
objectives and common sense judgement of the practical, everyday skills needed bv 
adults. By 12th grade, 89-99% of the students have passed the test series The"^ ■ 
lowest percentage is for theimathematics testing results. ^ 

■ . At the elementary level, test results are sent to the schools for the devel- 
opment of teacher in-service training.. Teachers must plan each individual student's/'' 
remedial woxk^^^ secondary level, remedial wqrk is part of the regular, currix^ 

u I um. . , ^--^-"^ 



. . Remedial work is in the form of assistance-^in-'the regular classroom, remedial 
Course, before/after schoM -drop--in-programr in 'some schools, summer school at the 
secondary Level, turorial assistance, skills lab and special remedial materials at 
the secondary level. Special curricul um material s have also been prepared for 
remedial purposes. The- district pays all remedial costs. 

Test scores are only one factor in promotion and remedial placement deci- 
sions. Teacher judgement based on attendance, maturity, class aehieve'mVrrt, general 
progress and age (state law requires students to be in certain grades by certain 
ages},, are other factors. In order to graduate, students must pass the 10th grade test 
series and have sufficient credits. No special certificates are awarded to students' 
Who do not pass tests. Diplomas may be obtained in adult schools subsequent students 
.leaving secondary school . 



, The state has mandated that the district determine acceptable competency ■ 

-achievement le'vels. No court actions- have been taken! The district pays all costs 
except those of letters .mailed home to secondary students' parents which is reimbursed 
by the state. / . • 

, For further information on the Los Angeles testing program, please contact: 

" Marilyn Burns, Assistant Director of Testing \ / 

Frank JoSt, Testing Coordinator • ' ^' 

/ Los Angeles Unified School District 

Room G265, 450 North Grand • ' 

■ Lo"s Angeles, OA 90012 

Phone: (213) 625-6207- ' ■ 
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- ^ MEMPHIS 

The Memphis City Schools presently uses standard/ized achievement tests 
published by a commercial testing company in its system-w/de achievement testing 
program. The System also uses a commercially developed tfest in the administra- 
tion of the Tennessee Proficiency Testing Program. Scoring .of the system-wide 
testing program' is done by the school system. The profyciency tests are adminis- 
tered by the school system tfnd j^cored by the >s*tate. • i 

'PURPOSES.OF TESTING " ' / 

^ At the elementary and -secondary level, the /f^orm-Referenced Test (NRT) 
?-S.|x:§ed primarily for diagnosticXp.if,yiposes and measurement of achievement. Program 

evaluation of Title I academicaTlylbriented projects' uses Norm-Referenced Tests 

also. The NRT are administered during 'fhp/fall of /^he year for placement of students 

fm?^-d4^)^o-S4::S^ individual students, as well as for measurement of class strengths 



ahd^eakrfesses . The spring testing program is desy^'gned to provide assessment info'r 
and to determine the need for teacher in-service /training. ^ 



"Watidn related to curricul um , revision, to measure/district-wide achievement progress, 

7^ 



After the Norm-Referenced Test is "administered in the Fall, teachers re- 
ceive two computer generated reports, a Group I^tem Response Record and an Objective 
Mastery Report, both of which contain information on individual student. These \ 
reports .are u^^d by teachers to assess needs, /assign priorities, establish groups, 
and plan instruction. Results of the Spring jt^sting are used to monitor progress and 
evaluate results. Only test 's'cores from the /Spring testing are recorded on student 
permanent records. ' * ' / ""^ t_ \ 

/. ' • ■ . / _ \ ^ ' 

SELECTION OF TESTS / , k 

'The district has a test review committee comprised of research and testing. 

^personnel, teachers, principals, 'instructional consultants, and guidance counselors. 
The current test use'd by the district, tire CaliforniaiAchievement Tests (C.A.T.O, 
was selected after a -test committee heard presentatioips and reviewed achievement tests 

-submitted by several test companies . Tne district has no preset criteria for selec- 
ting tests. The selection of the tests/ was based on. finding a test which most' 
closely matched the district's curriculum, curricul um objectives and stated expecta-^ 
tipns of students. No competitive bid^s wer^" received since cost was not a criterion. 

TECHNICAL INFORMATION j '5* \ _^ ' 

As. the district has not designed any^of its own tests, there is^W informal 
tion of this nature. The Tennessee/ Proficiency Test,, which is administeredy^to high 
school students, was developed by a comme^ricaT testing cjbmpany with guideli/nes from 
a broad base of representatives fr/om across the state. No technical inforjt^ation is 
available for this survey. 

V 

ADMINISTERATION OF TESTS 

All students' are tested in their own schools. Principals are /responsible 
for. the security of all tests./ The C.A.T. and the state proficiency tests are dis- 
tributed by the district's research and testing division. Principals return all ' 
test materials to the research and testing division. Guidance counselors, teachers 
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experienced in testing, .or other experienced school personnel provide any necessary 
trai-.ning on testing procedures. ; 

MANAGEMENT OF TEST DATA 

The subscores" from the C.A.T. are on the student data base. The test data 
base contains test informati-on by student, class, school, and administrative area. 
Raw scores, percenti 1 es ,■ stani nes , grade equivalents, and summary stati;stfcs are 
reported. Item analyses by class and' class lists by school are also generated. ^ Ad- 
ditionally, the- data baseyTlows for analyses by race but not gender, language ^dfr . 
socioeconomic status. ' ' ' "x 



The Group Item Response Record and Objective Mastery Report are sent to • 
teachers, principals and area administrative personnel. An annual report to the 
Superintendent and the Board of Education includes achievement test data. . . . 

Assistance in interpretation and use of test result^ is given to.teachers 
in staff development workshops and in -special -workshops conducted by the Division 
of Research Services. There is no system-wide 'focus on . assi staiice for parents.-'^ 
Test results are not sent home, but parents may be-i.nvited to , discuss results with 
teachers in individual schools and cases. Occasionally, group" meeti ngs with parents - 
are held by the research division. i 

; Subsist sc,:or,es 'on the C. A.T. ,i.jr.ade equivalents, stanines, and percentile 

ranks are prfnted 'on'i'kb which are given to teachers to be placed on student -^i 
-f-ijes. Studenf^s, parens, teachers, principals, selected administrative personnel . 
and "the research', divisi^.' have access to student records. 

. ! , \ ; , ■ ■ ^ ■ - 

; Tapes" of test results are presently maintained for 5-10 years. The time 
span will increase, however, in the near future when the district acquires, micro- 
fiche equipment. . . 

The research division is a separate division from Curriculum and Instruc- 
tion, but representatives from both work together on test committees . The research 
division is in charge of test administration. 

TEST RESULTS ' . ' ; ••; ; " " ■ 

The standards for passing the State Proficiency Test were set by the state. 
Currently, students must achieve a score of 65% correct in math and 75% correct in 
reaching, language and spelling to pass. Each school has automatic remedial courses, 
paid for by the district, for students whofail. In addition, remedial assistance 
is proVidedin the regular classroom and, in some' school s , by area college students . 
who provide tutorial assistance. • ' 



Test scores are not a' factor in promotion dec^i'sions. When deciding t# 

^ student for 'remedial wor*k, teacher recommendations are also a- factor . As 

of the class of 1983r students must pass the state t^st, in order to graduate, feven 
other requirements have been met. . '"*H<^;;v.Sv 
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place a student for 'remedial wor*k, teacher recommendations are also a- factor. As 
of the class of 1983r students must 
if all other requirements have been 

• ■ T ■ ■ 

Students who pass the Tennessee Proficiency Test will be awarded a regular 
diploma. Those who do not pass after repeated testing will receive a Certificate 
of Attendance but will have the opportunity to return and retake the test. 

• ; • ." , -85- 



^v:^ ACHIEVEMENT TESTS (MEMPHIS) 



~Urape~T 
Tested 



Nome of 
Tor.t 



Cal 1 fornla 

Achievement 

Tesf 



2 & r Cdllfornla^ 
Achievement 
Test 



4 & 10 California ( 
Ach1evement\ 
Test > , 



Designed 
by Whom 



Art>tis 
res tod 



CTB McGraw- 
Hill 



CTB McGraw 

Hin 



CTB 

McGraw-Hill 



V 



9-11 * Tennessee Profi- 
ciency Test 



Sta,te 



Pre-reading 
Reading 
Language 
Math 

Reading, Lan- 
guage, Math 



Readirif ; / 
Spelling. 
Language 
Math 

Reading, Math, 
Spelling, Lan- 
guage, Refer- 
ence Skills 



'.Metric 
or 



When 
Given 



Percent i^W^^ Sp r 1 ng 



Percentiles^ 
Raw Score 
Stanines 
Grade equlv. 



Spring 



Fall & 
Spring 



Fall & 
Spring 



"NRT7" 
CRT 



NRT 



NRT 



NRT 



NRT 



Torms 
Used 



MINIMUM COMPETENCY TESTS 

Math, Reading, Percent • CRT 

Language, correct 

Spelling 



Fomi C 



Form C 



Form C 



Forms C & 
0 



State pro- 
duces new 
test each 
year 



Norms 
Used 



National 



National 



National 



National 



Sf^ate 



General Purposes 



Oiiignosis of. Individual 
students, measure of 
achievement 



Diagnosis of Individual 
students, measure of 
achievement 



Diagnosis of individual \ 
students, measure of achieve- 
ment ' ^ 



Diagnosis of individual stu- 
dents, measure of achievement 



Graduation requirement as of 
Fall of 1983. Students must 
pass only ,on^ time; Those 
^ who fail retake uptll passed. 



li 
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V Except for the proficiency requirements spe4:ifie'd by the state, no mini.- 

Dium achievement levels are specified or proposed. The district is reimbursed by, 
the state for testing in grades K-2 ,as part of the Tennessee Assessment of Basic . 
Skills for which the C.A.T. is used. The state also pays. the total cost of the 
State Proficiency test. All other, costs are carried by the .district . 

For further information on the Memphis assessment program, pTease contact 

Dr . O.Z. Stephens 
\ . Director , 

(or) ■ 
.\ Dr. Joyce B. Weddington 

Coordinator . . ^ • . 

Division of Research* Service? 

2597 Avery Avenue /' " , 

• Memphis, TN 38112 ' ,- 

Phone: (901) 454^5450 or 454-5333 




\ ■ ■ ■ 
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The district uses -only standardized achievement tesfs published by com- 
mercial testing services. The Basicf^'kills- Assessment Program, designed by ETS 
and published by Addison-Wesley, serves as the c^istrict's minimum competency test. 

• ' . / /. ■ , 

PURPOSES OF TESTING , ■ / 

> • ' / 

The district's NRTs are used at both elementary and secondary levels: 

. • for program evaluation / ■ ' ' 

I for placement of students / 

I for diagnosis of individual student -strengths/weaknesses 
C to place students in remedial classes 

• to assess/the need for curriculum revision .^••/. 
• • to-meas)jfe district-wide achievement progress 

The NRT-s also have limited use as . one/-of many criteria in promotion decisions . 

The district's CRT is used at the elementary and secondary levels: 

! I for program evaluatiojl . ' ' 

• for placement of students ,v . ,• - . ■ 

• for diagnosis of individual- student strengths/weaknesses 

• to place students i/n remedial classes 

Test results are also used in/the evaluation of federal programs. 

Tests ar:e referenced against the curricul um to some extent. Test results 
are used both by th'e testing office and curriculum and .school staffs to deterno^ne 
areas of weakness in the/urrtculum and" to identify' specific students and groups of 
students requiring intervention strategies'. ...^ 

SELECTION OF TESTS . / ' ' ' , /■ .■^ j.. 

The di stri e't has% City-Wide Testing Program Advisory Committee consisting 
of teachers,. counselors, administrators and a cross-section of central office _ 
personnel; The district does not involve test publishers' personnel in, the review 
process. Sampl e /material s are obtained from the publishers and the.selection is 
made based on a/review process conducted by the committee^ ?f thp'fo?m are 
"review form was used during the last sel ection process . Copies of the form are 
available" from the C(5CS. At the time the ITBS was ^el ected in 1980,- 1 1 was pilpted. 
at three grade levels using a sample of 300 students prior to implementation.- The 
district do4s not receive competititve bids. , 

• ADMINISTRATION OF TESTS ' ' , 

All students in regular classes.^n grades K,' 2, 5, 7, 8, and-'lO are tested 
with a standardized achievement or aptitude test. .At S^^^e 12 , studeW^s are se^ 
selected to take one of three tests. All testing is conducted in the students 
school s. . ' ' ' 



' .provisions are .made for test security through written communication from 

the' testing office to principals. The tests are^stored in locked rooms in the" 
schools, and principals" are responsible for distribution and collection from stu- 
dents. "The competency tests are pre-numbered, sent to the schools prior to testing 
and returned immediately afterwards. 

Training on test procedures is handled, with detailed written -procedures 
and through in-service activities. 

/, Newly arrived foreign-born students with difficulty speaking and under- 
standing English as welT as students enrolled in special classes (EMR, BD, LD, 
ED), visually handitapped, and deaf/hard of hearing students are all exempt from- 
the district's achievement tests. Students who are identified as limited-English 
proficient by set procedures under Lavy-are exempt from the minimum competency^ 
test. Special education students may or may not be tested based on their Indivi- 
dual Education/Plrogram. No special adaptations of tests are made for hand,icapped 
or limited or/non-English proficient students. \_ 

MANAGEMENT /DF TEST DATA ' ^ . , , ' , . 

The d44trict mai,ntains a centralized student data base (SDB) with infor- 
mation on all students keyed to individual student I.D. numbers. The student test 
files are separate. The test files generates list reports, item performance, analy- 
sis reports, frequency distri butions , al 1 summary statistics and individual 
machine-plotted profile forms. Analyses by gender and, race are not done. 

' T.he distric.fe issues an annual School Profiles' Report to the Public. The 
rep^^'t contains a description of the district's achievement tests, an explanation, 
of the measures used and their meaning, test results by grade level for the system 
and for each school and a longitudinal comparison of test results. 

Assistance with test result interpretation is given to teachers through 
written comn;iunications and in staff meetings conducted by measurement or curriculum 
personnel.^ Parents are provided an explanation of test result meaning on a locally 
developed profile form. The profile is a machine plotted form using bar graphs to7 
coyer the range of possible performance. Parents are encouraged to confer with | 
school personnel hfter examining the profile. ' 7 

\ . The only- test data recorded on the student data base (SDB) is- a code / 

which refers to the status of the studerit-on competency measures. Only testing/ 
office. staff have access to the. test data files. . ll 

Summary data by school .is mai ntained , throughout the life^of a given //"test- 
ing program. No longitudinal dalfa: on'individual students is jnaintained although 
IndiYidual test tapes could be accessed to acquire such data by means of the SDB 
I.D. ^ ' , . . 

The research department and curricul um *and instruction a re '-ij- .separate 
divisions but report to the same superintendent. The departments have a close 
working relationship. The administrator of the- City-Wide Testing Program in the 
Educational Research and Program Assessment Department is in charge of test program 
administration. 
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ACHIEVEMENT TESTS (MILWAUKEE) 



urade 
Tested 


INainr? of 
Test 


. Designed o 
by Whom 


Areas 
Tested 


Metric 
or UM* 


When 
Given 


NRT/ 
CRT 


Forms 
Used 


Norms 
Used • 


GeneraJ^^rposi.s 


Pre-K 


Pre-Scho.ol In- 
ventory 


Betty Caldwell Motor and 
' and ETS other pre- 
school skills 




Early in 
Kinder- 
garten 
year to 
pre-school 








^ri^poninn t'n rlof'OK^iiino t^PAH'Inocc 

for formal schooling 


K 


Metropol 1 tan 

Readiness 

Test 


HBJ Psych 
Corp 


Reading Readi- 
ness, numbers, 
general 


Percen- 
tile ' 
rank 
Stanine 


May 


NRT 


Form L 
Both levels* 
1 and 2 ^ 


National 


Screening to determine readiness ' ' — 
for formal schooling ^^1 ^. , 

• 


2 


ITBS 


Riverside 
Publishing 


Reading 
Math 


Percen- 
tile 
rank 
Stanine 


May 


NRT 


Form 7 
Level 8 


National 


Assessment of achievement 








Non-Verbal 

Abstract 

Reasoning 


Percen- 
tile 
rank 
Stanine 


May 


NRT 


Fo rm 3 


f inn;) 1 

liu U 1 U 1 la 1 


Tn npf Pcfimafp nf Ahcfi^Arf exilic 

related to achievement — - ' • 


5 


ITBS 


Riverside 
Publishing 


Reading, Math-- 
required. Lan- 
guage Arts, and 
Study Skills op^ 
tional 


II 


May 

■ , ■ 


^NRT 


Form 7 
Level 11 


National 


Assessment of achievement 

j . ; ■ ' 


, 5 0. 






Non-Verbal 
• 'Ab$tract 
Reasoning 


II 


May 


NRT 


Form 3 
Level C 


National 


To get estimate of abstract skills 
related to achievement 


7 . 


ITBS 

/■ ■ ' 


Riverside 
Publishing 


Reading, Math 
(required), Lan- 
guage Arts and 
study Skill? 
optional 


II ' 


May * 


NRT 


Form 7 
.Level 13 


National 


Assessjnent of Achievement 
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•Milwaukee - Achievement Tests Cont'd 



\ 



bradc 
Tested 



8 



10 



I2f 



Name of 
Te^t 



Basic Skills 

Assessment 

Program 



Basic Skills 

Assessment 

Program 



VIr i t Vng 
Sample Per- 
formance 
Test 

Tests of 
Achievement 
and Profi- 
ciency 



Designed 
by Whom 



ETS-designed 
published by 
Addison- 
's Wesley 



District 



Riverside 
Publ Ishing 



Riverside 
Publishing 



Areas 
Tested 



. Metric 
or UM* 



R^n 
Given 



CRT 



Reading, Math 



(Reading, 
MathT"1f 
not passed 
in grade 
8) and 
Language 
Skins 

Writing 
Sample 



Reading, Mat;h 
(using Sources 
of informa- 



Raw & Stan- 
dard Scores 



Raw and 

Standard 

Scoi^es 



Holistic 



Percen- 
tile 
rank 



tlon optional) Stanine 



Serial sample 
of Reading, 
Math, and 
Sources of 
.Information 



Percen- 
tile 
rank 
Stanine 



April 



/ipril 



CRT 



CRT 



April 



Oct 



May 



CRT 



forms 
Used 



Mul tiple 



Multiple 



Korms 
Used 



Con oral P urp b s e.^ 



To get assess status relative to 
graduation requirements 



To asses5 status relative to 
graduation requirements 



To assess status relative to gradu- 
ation requirements 



NRT Form T National Assessment oi Achievement 

Level 15 



NRT i Form T 

; Level 18 National To obtain measure of "end-product 



1, 



'.J 
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TEST RESULTS 



The standards for passing the district's minimum competency tests were set 



by six committees of twenty members each which included parents, teachers, community 
representatives, curriculum and subject specialists and students. The committees . 
"carried out, a review of the competency tests using the NedeTsky and Angoff ipethods . 
Further, approjUJna-telx'StRritudents identified by teachers in six high schools as 
"ma5.ters" '■oF'"non-masters'' took the; competency tests, in the contrasti ng-groups pro- 
cedure. Finally in May 1981, the tests -in reading and math were administered to 
all 8th grade students to initiate, the program. 

Students must currently .achieve 50 out of 65 items correct in reading, 56 
out of 75 in writing, and 40 out of 70 in math to pass . However, these standards 
are tentative and subject to revieW/as additional experience with the competency 
tests is gained. 



Students who do not reach required levels will receive some type of inr 



structional follow-up; This provision will be a function of what regul ar. courses 
are available and where the student has scored below the Cutoff. Students within ^. 
certain ranges below the cutoff may be ah/ie to achieve proficiency through regular 
classes'. In other cases, the 'district expects to , identify gro,ups of students in need 
and when possible, 'place them together in regular courses. 

" Currently, remedial assistance is available in the regular classroom, in 
remedial couV-ses, in summer school, skills labs and from tutors . The district pays 
for all remedial work. = Students must pass 'the competency test to graduate even if 
all other requirements have been satisfied. The district will not award certificates 
or special diplomas to those who'do not pass the competency test. Such students 
will remain candidates for graduation after completing all credits required until such 
time as 'they pass the test. ' . ■ 

Test scores play an extremely limited role ,in promotion deci'sions. Class 
work, grades, and physical and emotional development are primary criteria. In addi- 
tion to test scores, the subjective judgment of teachers is a factor in determining 
remedial i nterventi on 'fdt'' students . 

' Neither the district nor the state currently specify minimum achievement 
levels The district has published grade level expectations for reading, math and 
language skills but these are considered targets and not mindmums. No legislative 
measures have been propos-ed which would set minimum levels arVd no legal actions have 
treen taken against the district for the use of any tests. 

The district pays the entire cost of the student assessment program. For 
further information on Milwaukee's student assessment program, contact: 



Elfred Bloedel, Administrator " 

City-Wide- Testing Program 

Department of Educational Research and 

. Program Assessment 
Milwaukee Public Schools 
Administration Building 
PO Drawer lOK 
Milwaukee, WI 53201 
Phone: (414) 475-8265 
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MINNEAPOLIS 



The district uses both standardized tests pu5TTsheci~"B5ra commerciar — 
testing service and district-des-^igned achievement tests. 

PURPOSES OF TESTING ' ^ \ • , ' 

. At both the elementary and secondary levels NRTs are us^ed: ' 

• to measure ddstrict-wide achievement progress ' 

• to measure. individual student progress 

l^to assist with educational and vocational planning for individual 
---"""^ students . ^ • 

• to evaluate programs . ^ 

i to assess the need for curriculum revision 

At the present time, mathematics CRTs are used at grades 7 and 8 to assess students' 
mastery of arithmetic skills and concepts. In the next five years CRTs wilLbe^^de- 
veloped at both .the elementary and secondary. level to assess .individual and district- 
wide achievement of grade level objectives in reading, mathematics and language arts. 

Curriculum specialists city-wide examine test results and item analyses to 
determine areas of strength and weakness. Curricula are then modified to strengthen 
weak areas The district-designed tests are curriculum referenced while commercial 
tests are as, close as possible to curriculum objectives and content. 

SELECTION OF TESTS . • 

The district has a city-wide Evaluating Techniques CommiUee comprised of 
principals, teacher, counselor's, other staff personnel , curriculum consultants and 
testing personnel. When a test is to be selected, a ^subcommittee comprised of ex- 
perts in the subject area is formed. This subcommittee also draws in subject ma'tter 
.teachers from outside the committee. Tests are reviewed and thre6 which best match 
the curriculum are selected. The three tests are piloted, feedback is solicited 
from teachers and the committee makes a filnal selection. There are no pre-set criteria 
and competitive bids are not received from commerical publishers. ' 

TECHNICAL INFORMATION . v ; . - 

Preliminary results indicate that the Grade 7 and 8 mathematics CRTs are 
reliable. Since these tests have been referenced against the 'Curriculum, content 
validity is assumed. In the development of future CRTs in reading, mathematics and 
language arts, reliability studies will be made. These tests will be designed- to 
measure content objectives. Test items are examined to check on cultural, racial ^nd 
gender bias . 

ADMINISTRATION OF TEStS • • 

With the exception of the subject-specific tests administered only to 
students enrolled in 9th grade science and 12th grade .economics , all tests are admin- . 
istered to all students in every school in the students school s . 
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Test security at the senior high level is the responsibiTity of counselors. 
The testing office sends memoranda regarding security measures and necessity. At the 
el eme ntar y lev e l, test secu r ity rs— th^-^et ponsibil ity of school principals ^ — A11 test s- 
are to be kept under lock and key. • .. 

At the senior high level, counselors are charged with advising on test 
administration procedures and must monitor test administration. Occasional workshops 
on testing procedure are given at the elementary level. > 

Students in Special Education -cl asses over 50% of the time are exempt from 
tests as are handicapped. Limited English proficient students must be tested but 
scores are not included in the overall results. The Limited English Proficient Division 
uses these results to assist students. ■ * 



MANAGEMENT OF TEST DATA 



\ 



The district maintains a centralized computer base for all students in all 
school s , -from grade K through 12. All test data are recorded on the student data base. 
A list report of individual student scores, frequency distribution by test with summary 
data for the school, area a-nd district are generated. Item analyses are also 'availa- 
ble for selected tests. The data base allows for analyses by school, gender, race, and 
Engli s h^ non- En gl is h^^ proficient . 

Each year'a "Profiles of Performance" report, which covers all NRTs, iS| 
published. This report summarizes city-wide testing over the preceding 8-10 years and / 
also contains individual school profiles. It is distributed tlD the media, libraries 
and school s . 



Teachers receive assistance, on test result interpretation through memoranda 
from the Testing Office. Test results in grades 4, 8 and 10 are sent^home^on a student 
profile which includes an explanation of test score'S^and interpretation. Parents also 
receive assistance during conferences with teachers and counselors. 

A computer-generated label with raw scores and primarily local percentiles 
for each test is placed on; students* files. Teachers, counselors, administrators, 
parents and students have access to the records. Occasionally researchers are 'permit- 
ted access but are not allowed to connect student identification to test data. 

The Research Department and the Guidance^ and Assessment Department are 
separate and report to different superintendents. The Department of Guidance and 
Assessment Services is in charge of test administration. 

The district has implemented a schedule for mastery testing at each grade 
level in the curriculum areas of reading, writing and mathematics beginning in Spring, 
1983. In addition, strategies and interventions are being developed for assisting 
students who fail tests or fall below minimally acceptable levels at designated 
"promotional gates." The strategies will focus on-improving basic skills achievement, 
using supplementary personnel and the best teaching strategies and suppl emen1;ary 
materials and equipment available. Remedial work will primarily take the form of 
assistance in the regular classroom. There are presently skills labs for math, and 
tutorial assistance is availabl e 'for Title I students. 
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ACHIEVEMENT' TESTS 



Ui'dde 
Tested' 



ri.iine or 
fest 



Designed 
by Whom 



Tested 



Metric 
or UM* 



When 
Given 



Hetropol i tan 
Readiness Test 



Stanford. 
Achievement 
Test In 
Reading 

California 
'•Achievement 
Test in Math, 
Stanford 
Achievement 
Test In 
Reading 



Psych Corp 



Psych Corp 



Psych Corp 
McGraw-Hill 
Calif. Test 
Bureau 



Word Meaning, 
Listening, 
Hatching Alpha- 
bet Numbers, 
Copying. 

Vocabulary, 
Word Study, 
Reading -Words 
and Composi tion 

Vocabulary, 
Word Study, 
Reading Words 
and Composition, 
Math 



Raw Score ' 
Local 

Percentile 



Raw Score, 
Local percen- 
tile 



Raw Score, 
Local per- 
centile 



Fall 



Fall 



Fall 
Spring 



Psych Corp 



Comprehertsion 
Vocabulary 
Word Study 
Skills 



Raw Score 
Local Per- 
centile 



Fall 
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Cal Ifornia 
Athlevemient 
Test in 
Math 

Cal i fornia 

Achievement 

Test 

Cal Ifornia 

Achievement 

Test 



Stanford 

Test of ■ , 
Academlc|^*^ 



c(/r 



Mc6rayv-Hill Math 
CcVl ifornia 
Test/ 
urjjau 



•McGraw-Hill 
/ California 
/ Test Bureau 

^ / 

/McGraw-Hill 

/ California 

/ Test 
I Bureau 

Psych 
Corp 



Skills 



Reading 
Spel ling 
Language 

Math 



Reading 
' English 
Math 



'Raw Score 
Local I 

Percentile 



Raw Score 
Local 

percentile 

Raw Score 

Local 

perc§ntil 



Local Per- 
centiles 



Spring 



Fail 



Spring 



Fall 



NRT7" 
CRT 



Forms 
Used 



Norms 
Used 



General Purpos es 



NRT 



Form B 



Local 



Readiness for reading and Math 



NRT ^ Primary Local Measure District Reading Achieve- 

Level 1 merit, Individual Progress Reporting 

Form A tol publ ic 

NRT Primary Local Measure District Readijig Achieve- 

Level II, ment. Individual Progress Reporting 

Form A; to. publ ic; measure District Math. 

Level 13, Achievement, Individual Progress* 

Form C Reporting to pjjblic 



NR' Primary . Local " /Measure District Reading Achieve- 

Level III, iment, Individual Prqgress Reporting 

Form. A I to Public 



Intermedi- Local 
ate Level Iv 
J Form A 

/ Intermedi- Local 
/ ate; level II , 
' Form A 



NRT 



NRT 



NRT 



Level 16 
Form C 



Local 



Level 10 Lqeal 
Form C 



Level 18 Local 
Form C ^ 



Measure District Math Achieve- 
ment, Individual Progress Re- 
porting to publ ic 

' / 

Measure Distirct Achievement / 
Individual Progress Reporting jtb 
public' / 

Measure Distirct Achievement, 
Individual Progress Reporting to 
public / ' 



NRT 



Form A 



Local 
Norms 7 



Measure District Achievement, ' 
Individual Progress/Reporting ' 

'. L- ^ 



COMPETENCY TESTS (MINNEAPOLIS) 




brade 
Tested 


Name of- 
Test 


Designed 
by Whom 


Areas 
Tested 


Me t r i c 
or UM* 


When 
Given 


NRT/ 
CRT 


=— 

r orins 

Used 


Norms 
Used 


General Purposes 


/ 


Minneapolis 


District 


bociai btudijes 


Raw score 


rail ana 


COT 


Varies 


Eva 1 ua te 


Social Studies ^curric- 




Social Studies 






Percent 


Spring 






ulum 






Test 






correct 














Hinnedpo 1 i s 


Uis trict 


Math Computa- 


local per- 


Call anri 

ra 1 1 ana 




- New Forms 


Evaluate 


curr 1 cu 1 uin , neip group 




Arithmetic 




tion 


centiles 


Spring 




each time; 


students 






Computation 










7th & 8th 








f est. 












Grade ver- 




* 
















sions 






8 


Minneapolis Cri- 


District 


Math Concepts 


local 


, Fall and 


CRT 




Evaluate 


curriculum, help group 




terion Refer-. 






percentiles 


Spring 






students 






enced Test 


















9 


Minneapolis 


District 


Science 


^ local 


end of 


CRT 


Different 


Evaluate 


curriculurti, help group 




Science Test 






percentiles 


1st & 2nd 




each year 


students 












trimester 










12 


Minneapolis 


District 


Economics 


Local 


Beginning 


CRT 


Different 


Evaluate 


curriculum, help group 




Economics 






percentiles 


end of each 


each year 


students 






Test 






*» 


trimester 
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When determining whether or. not to promote or recomme'nd a student for re- 
medial assisteince, achievement w>l1 be .the primary basis for promotion, although 
a student's physical, psych^J^Tgical ancT sociological needs must be considered. " 
Local ly developed criterion-referenced t^ts at promotional gates are used to identi- 
fy" students not performing up to, minimal level s . These students are retained if the/ 
do not pass minimal levels of achievement af^er repeated interventions have b6en- tried. ^ 

The state, does not specify minimum achievement or competency levels and 
no legislative measures to this effect. have been proposed. However, the district is 
in the process of determining required levels of achievement at specified "promotional 
gates. ^' The district pays the entire cost of the student assessment program. 

For further information regarding the Minneapolis assessment program, please 

contact: . 

Sharon Heffel finger 

Minneapolis Public Schools. ' ' . 

807 Northeast Broadway , , ^ . 

Minneapolis, MN 55413'^ ' . . ' 

Phone: (612) 348-6072 ^ , • 
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NASHVILLE 



The district uses standardized achievement tests published by commercial 
.testing services and state-designed minimum competency tests. 

PURPOSE OF TESTING ' j ; ' ' 

^ Testing (NRTs) is primarily used to diagnose student strengths and. wt^ak-^ 
ness.es, to assess the need for curriculum revision, and to measure district-wide 
achievement in grades K-8. To a limited degree, it assists in determining the needs 
for teacher in-service training. The results are also used, for Title I placement. 

.Tests are referenced against the curriculum. Re-^^rch and Testing 
evaluate test results and based.on that evaluation. Curriculum and Instruction 
makes necessary modifications in the curriculum. Some schools also request direct 
assistance based on item response analyses. 

SELECTION OF TESTS * . 

■ • "■ t 

The district has a standing test review committee comprised of teachers, 
administrators, subject area supervisors, counselors and Testing and- Evaluation 
^personnel. Criteria are now being developed for use when *sel ecting tests from com- 
mercial publishers. When the district decides to change tests, samples are re-^ 
quested in'advance from publishers who are then invited to make a presentation-. 
The tests are rated and in future, the top choices will be field tested before.a 
final decision is reached. No competitive bids are received. 

When designing district tests in the past, -teachers were first brought 
in during the summer andpaid to* write test items to objectives. The second time, 
all teachers were invited to' submit items and $15 was paid for each item selected. 

TECHNICAL INFORMATION 

Since the district used mainly . commercially published NRTs, they rely on 
publisher's data with respect to reliability, validity and bias. . 

The state-designed Tennessee Proficiency Test is presently being examined, 
for reliability and validity using Vanderbilt and Peabody Universities. Because 
the state did not request race and sex information onanswer sheets, no analyses 
have been done yet to determine the presence or absence of cultural, racial or 
gender bias.^ This will be done, however ,• starting. this Spring. 

ADMINISTRATION OF TESTS 

\ . All students in all schools are tested in their own schools. NRTs are 

numbered, kept in a warehouse and sent to schools. When the district receives 
the state Proficiency Test, they are weighed to. determine the accuracy of the count. 
They are -numbered, sent out to schools, and co.unted upon return. Complaints are 
made if tests are missin-g but a different form j^s used each year. 



/ 
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Teachers are provided in-service training on testing p^i^ocedure whenever 
a new test is adopted. > ' ' j; 

Only , full-time special^education students are exemptjprom tests. LEP . 
students are tested in English, The Tennessee Proficiency Test; is. available in 
Braille and large print for vision-impaired students, Orthopedical ly handicapped 



// 



students who cannot write have someone to mark tests, 

. MANAGEMENT OF TEST DATA 

, The district maintains sepa^rate student and NRT te^t data bases. The test 

data base contains individual and school results by test and^year, and student 
sex, race and identif icati^on number . Additional student da/fa can be accessed 
from the student data base through, th^e I.D. nifmber. j 

The district produces mean raw scores- and mean ^anines foe the system, 
percent ;0f students in each Stanine at system and scho.ol level individual raw 
scores , fpercentil e ranK and Stanines, as well as all sumn[ja ry statistics except 
medians-. A class record sheet is generated which shows f^avi percent, Stanines and 
normalized T-scores. Each classroom receives an item response record from 
McGraw-Hjll. School summaries. by grade are also produc£!d. 

•The test data base does not show individual Responses but contains raw 
score, percentile rank, Stanine and T-score, A gummed/ label for cumulative, 
records is produced which shows each subtest raw scor/^, percentile rank, Stanine 
"and T-score, Only research and evaluation personnel /have access to the test data 
base but school employe|s, parents and students oven/ 18 have access to cumulative 
records . , ^ , ^ 



A'special report on NRT test results by face is issued to the court under 
a desegregation order. Longitudinal reports are i/issued to the press for as many 
years as are comparable. School system reports aire sent to the Board of Educ^ation 
and Superintendents. / 

A testing guide provides teachers with assistance in interpreting results. 
Parents are given a profile, card which has a graphic presentation of scores and 
contains an explanation of the meaning of scores and degree, of accuracy. 

Curriculum and Instruction are separate from Research and Evaluation but- 
the results of tests' are brought to the attention of Curriculum and Instruction. 
Research and Evaluation is responsible for ^test administration. 

TEST RESULTS . ^' . ^ 

Ninth graders who fail the Tennessee Proficiency Test have the opportunity 
to take a preparatory/remedial class in summer school for a minimal fee. Ninth . 
graders who fail one of the language subtests are re,quired to register for a reading 
*class in 10th grade in addition to their regular curriculum. Schools with the 
highest failure rate in math are provided additional math teachers to lower the 
pupil /teacher ratio. ' * . 

The initial failure rate/for 9th graders was about one-third. It is 
anticipated to be less than 10 perp'ent by 12th grade. The district pays for all 
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ACHIEVEMENT TESTS (NASHVILLE) 



urade 
Tested 


Name of 
Test 


Designed 
by Whom 


Areas 
.Tested 


Metric * 
or UM* . 


When 
Given 


NRT/ 
CRT 


Forms 
Used 


Norms 
Used 


/ 

! 

General Purnoses 


■'. ... . : ■ . 



2 

4-8 



California 
Achievement 
Test. 



Metropoll tan 
Rendiness 
Testt Psych 
cJrp 



C.A.t./CTB 
McGraw-Hill 



CTfis 



CTB/McGraw- 
Hill ^ 



Battery 



CTB/McGraw- 
H1.1 1 



Reading, Math, 
Language 



Battery 



Reading 

Math 

Language 



Don't 
report 
K and I 
Grades 2, 
3 

Mean raw. 
scare for 
system 

Mean Stanine 
for system 
Percent of 
:.;sfudents 1n 
each stghine 
at system 
' and' school 
level 

Individual 
raw score, 
percentile, 
rank, 
stanine 

Group sta- 
tistics to 
schools and 
State Dept. 
of Ed. 



Spring 



Fall 



Same as 
K-3 



Fall 



Spring 



I - 



NRT 



NRT 



NRT 



Form C 



National District wide achievement progress, 
diagnosis, curriculum revision 



Level II 
Form P 



Level 12 



Forms S and 
T 



National State mandnte to test all 1st and 2nd 
graders statewide 



National Same as above 

National District wide achinyomcnt proqress, 
diagnosis, curriculum revision 



:Rir 
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MINIMUM COMPETENCY TEST (NASHVILLE) 



Urade 
Tested - 



Name oT* 
Test 



tios fgned 
by Wf iom 



Areas 
Tested 



Metric 
or UM* 



Tennessee Profi- 
ciency Test 



Originally from Reading, 

Scholastic Test Spelling, 

Service, in Language, 

future from Math 
State Dept. of 
Ed. 



Percent 
i terns 
correct 



When 
Given 



NRT/ 
CRT 



Forms 
Used 



Norms 
Used 



General Pu rp oses 



Spring 
for 9, 
10, 11 
12th " 
Fall & 
Spring 
gth grad- 
ers who 
pass sub- 
tests 
must not 
retake. 
Other students 
are retested 
on subtests 
failed until 
they pass all 
parts. 



CRT 



To measure competency -.for 
graduation. Graduation re- 
quirement as of class of 1983. 



1 3 -J 
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remedial work which, in addition to the above, includes regular elassroom assistance. 

> * In addition to test scores, decisions to promote or place a student for . 
remedial work are based , on teacher judgement with- respect to grades, classroom work 
and maturity. -As of 1983, student must pass the Tennessee Proficiency Test to 
graduate even/i-f all other requirements have been satisfied; -\ 

Students Who pass the Tennessee Prof iciency^Test .with perfect scores 
receive special certificates in recognition of their accompi isl;jlnent. Those who 
do not pass, receive a Certificate of Attendance in lieu of a diploma. Thereafter, 
students' must pursue a high school equivalency degree. 

With the exception of funds for state competency tests, the district. 
Pl^ys the entire co^t'of the student assessment program. 

- For further inforrmation on NashvilleVs testing program, please contact: 

Mr . Tom Caul kins 

Nashvill e-Davidson' Metropol i tan Public Schools 
• 2601 Bransfprd Avenue 

Nashvi'lle, Tennessee 37204 , ' ^ 

■ ^■ ". Phone:- (615) "259-5856 ' '. ' ' •. ■ ' ' . 
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NEW ORLEANS ■ 

The'district uses standardized tests published by commercia.l testing services 
\and state-designed minimum competency tests . The ^district also has developed a Secon- 
' dary Curriculum Improvement Program. (SCIP) which is a self-paced mastery program, only 
• one aspect of«whi(^ is objective-based testing. 

PURPOSES OF TESTING . 

NRT test resu-lts are a factor at both elementary and secondary levels 

I in program evaluation ' . 

• in placement of students 
. I in diagnosis of individual student strengths/weaknesses 

• 4o place students in remedial classes (elementary only) 

• to assess the need for curriculum revision / • 
.•to promote -students from one grade to another . 

.1 measure district wide- achievement progress 

\| to determine the need for teacher in-service training 

CRTs are used at the secondary level to assist nn diagnosing individual student 
stre-ngths/weaknesses,.. Jest resjuUs. are also us-ed in the evaluation of federal programs. 

Vest are referenced against the curriculum to the extent 'possibl e The 
■ testing department disseminates testresults to the curriculum department, educational 
supervisors and program developers, who. develop programs based on the information. The 
testing office,- which is part of Research and Evaluation, responds to reques^ts for 
assistance for in-service from the schools. • 

SELECTION OF TESTS " \ 

When tests are to be selected, an ad hoc committee' consisting of teachers and 
administrative personnel, including supervisors or directors from Curriculum, Testing 
Research and the Computer Office, is formed. 

All major tests on the market are reviewed and publishers' presentations made 
to test specialists. The leading candidates are selected and presented to the committee 
The final selection is based on pre-set criteria developed by the district. (A copy of 
the criteria'is available from the CGCS). No financial criteria ha've been determined. 
The district may receive bids. ^ 

'Test items for district-designed tests are developed .by teachefrs. No item 
banks or pools are used. However, t^'dT strict ha's no district-designed\sta,ndardized 
tests. > ' _ \ ' 

ADMINISTRATION OF TESTS • . ' \ 

All students in all Schools- are tested on the district wide NRT and all test- 
ing is conducted in the students' schools. Tests are retained in a central depository 
•^and disseminated to principals and testing coordinators who are responsible, for test 
security in the schools. School personnel sign for receipt of tests and return them. 
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Principals and teslting coordinators receive in-service trai ni ng on_t'est pro- 
cedure one-hal f day £^c^--^^ax. The training is, conducted by the Director of Research 
and Evaluation and t^esfing specialists. The principal s -and testing coordinators are 
responsible for faculty training. 

Special education students are exempt from the CTBS. Braille and large 
print versions of tne state tests are available for vision-impaired students and 'other 
handicapped students have modified test administration, limited English proficient 
students are encouraged to take the state te^ts in. English but may be exempt upon re- 
quest. . / 

MANAGEMENT OF TEST DATA 



The district has no test data .base for the state minimum competency tests. 
It has maintained*tapes of CTBS tests since 1975. The tapes show student name, identi- 
fication number, date of birth, race,, sex, date of test, items and subscores. The 
base generates individual item analyses, summary scores, class lists, rankings by 
c.lass, grade and school, item analyses by grade and school and school summaries of 
percent correct/incorrect. The data base allows' only for analyses by school. Although 
sex and race information are' on tape, the district does not have a program which reads 
this information. The test data base and student data base are separate and cannot be - 
merged • . * - . . . ' .' 

The district, produces a-n ann'ual Tisf of school profiles which' shows summary 
data year-by-year by-^chool and grade. 




I Reports -on test results which contain an explanatory page are disseminated 
to pjarents and teachers. The testing office also responds, to requests from teachers^ 
and parents for further assi.stance with interpretation of test results. ^Individual 
schqols may provide additional ass1sta.nce. . 

Labels showing students subscores and totals in reading and math from the 
CTBfe are. placed on student records. The state provides information on the percent of 
itens correct and objectives mastered ,on the state minimum competency tests. One 
Qopy is sent to parents and one copy attached to students' records. Schoal personnel 
and parents, students and researchers upon request have access to these records. 

The Research Department and Curricu] um and Instruction are under different 
superintendents but work together formally and informally. The testing office in 
Research- coordinates test ' adminis^tration . • - . . 

TEST RESULTS - . . ' 

^ — '■ * . 

'Standards and cutoffs for the minimum competency tests are determined by 
the state. The district is currently in the process of switching from the Louisiana 
State Assessment Test to the Louisiana Basic Skills Assessment. This year all second 
graders in the -state wi'll take the new test whi le al 1 other grades' tested will take 
the old test. ' Each .year each successive grade will, take, the new test -and the old one 
will be dropped as the grade level is reached. 



Any student Who. scores below 75% 
receive state funded remedial assistance. 



on the new' competency testwill automatically 
Currently , various forms of remedial assistance 
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Tested 



Pre-K 



K-12 



3. 7, 

10 



Nalne.dF 
Test 



Designed* 
by Whom 



Cooperative Pre- 
school Inventory 



CTBS 



CT8 McGraw 
Hill 



Louisiana StafA 
State 

Asses'siiie*^.t ' 
Test 

To be replaced with 
Louisiana iBasic -{. State 



Skills Test 



Areas 
Tested 



ACHIEVEMENT TEST (NEW ORLEAN 



Metric 
or UM* 



When 
Given 



"7^ 




CRT 



Reading, Matjh 



Mai^hV Reading, 
Unguage/Writing 



-age SSC 
equivalent 
NCE 

Percentile 
Standard 
Scale Score / 




NRT 



/ 

CO^tPETENCY TESTS 

Percent Spring CRT 

correct 

/ 



Reading, Language- Percent March 
Arts, Math • correct April 



CRT 
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Forms"^"^ \ Norms ~ — 

\ '^sed General Piir pn.P^ 



Title I 



K.-Form A National and As designs ted under Purposes 

1- Form B . Urban of Testing 

2- Fonn C ' 

3- 12: alf 
ternate 

S&T ^ 



To provide n anincjful data on 
student achievement to educa- 
tors, parents, legislators, 
and citizens 



Will be used to replaced LAST 
by, testing each, successive 
grade each year uhtir LAST has 
been eliminated. Will be a 
criterion in promotion deci- 
sions. See section on test 
results for details. 
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are provided in varying degrees in variou<$ schoofs including assistance in the regular 
classroom, b'efore/a'fter school drop-in programs, summer school, skills labs and tutorial 
assistance. Remedial assistance is not necessarily tied specifically to test ' results . 

Results from the new state competency test must be a principal criterionjn 
determining promotion. Each school system must specify a pupil progression plan 'with 
criterTa for promotion. Competency test results must be given the greatest single • 
weightof ail criteria. However, the combined weights of other factors may override 
tH6 compet^ency test results. Students must not currently pass the competency test to 
graduate. , ' ... 

The state is presently in the process of developing minimum aohieyement 
levels for students but detai 1 s 'are. only beginning to emerge. No legal .actions have ^ 
been taken against t he district for us ing any tests. . : 

The state pays the entire cost'of its mandated assessment program. , . 

For further i nformation ..on New- Orl ean ' s student assessment program, contact: 

Dr. Ellen Peckman, Director . or Dr. Tina Franklin - - 

■Department of Research and Testing Specialist 

Evaluation ^ ■ ■ 

: New Orleans Public Schools: ■ . . . • 

■. .. •/ 4100. Touro Street'. ' ' ■•■ • " 

, ■ New Orleans, LA 70122 

Phone: (504) 288-6561 



NEW YORK 

New virk City uses standardized norm referenced acMevement tests published 
by conmercial testing services,, a district-designed Language Assessment Battery, 
district-designed criterion referenced tests, state-designed criterion referenced 
tests and state-deii )ed minimum competency tests. 

PURPOSES OF TESTING • ' . ' 

\ ■ NRTs are used at thevel ementary and secondary levels: 

I for program evaluation ■ 
.1 for placement of students 
• to measure district-wide achievement progress 

They are also a maj^ criterion in decisions to promote in grades 4 and 7 and. in 
special c,i rcumstances) may be used in the diagnosis of individual student strengths 
and weaknesses. CRT/' are used prima>ily for program evaluation. Test results are 
also used in the evaluation of federal programs. 

The NRTs are referenced' against the curriculum to the. extent possible. 
Psych- Corp is writing additional ..ma.th items for the Stanford Diagnostic Math Test 
which will match' th^e di'strict's curriculum objectives .and assist in improving student 
performance.. Currently, item by item analyses' from the math test are given to tea- 
chers (class' report) , principals and community superintendents to assist with curric- 
ulum planning aiid instruction. 

SELECTION OF TESTS - 

The district uses an RFP and bidding process for the selection of commer- 
cially published tests. Requests for proposals detailing test specifications are 
sent to publishers and a pre-bidders conference is held. Criteria for the selection 
of tests include quality, appropriateness in terms of curriculum match, norms accept- 
able to the State Board of Education for the evaluation of state funded programs, 
ability , to handle a large school system, and availability of alternate forms for se- 
curity purposes Test items are also reviewed to assure that cultural, racial and 
gender t?ias has been excluded. The Chancellor's Testing Committee which consists of 
representatives from the Chancellor's office, the Office of Testing, Education ^ 
Evaluation, Student Information Services and representatives from unions and parents 
groups are involved in the review and selection process. From those publishers who 
best meet the district's criterion,- the lowest bid is accepted and' a contract is 
■signed for a specific period of time, ^ . 

TECHNICAL INFORMATION ^ • ' . ' 

Determination of the rel iabil ity/and validity of the district-designed 
Language Assessment Battery is currently in progress. During test development, items 
were reviewed for cultural; racial' gender bias and analyses us.ing group comparisons 
will be conducted. *• ■ 

ADMINISTRATION OF TESTS 

All students in all schools are tested. Except for Special Education 
placement, i^^ testing is conducted in the student's schools. 
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The Office of Testing develops test security procedures which include when 
tests are to be sent and opened and how they are to be handled. The ^Inspecto-K 
General's office sends out personnel to\.do spot checks on where* and how materials ' / 
are stored and handled. That office also investigates reports of security violations. 
If violations are substantiated-, they'may suggest via \memo- that an alternative form • 
be used. If investigations determine that a test has-been used for instructional ^ 
purposes V. punative measures may also be taken. , 

The district has a specially funded program for district test liaisons 
who conduct workshops on test administration for teachers, administrators and princi- 
pals. 

The district encourages the participation of all limited English proficient 
students in the city-wide testing program although they may elect to be exempted. 
Special education students are tested if it is part of their I.E. P. ^, 

• On the s/hate competency tests, alternative testing techniques are used for 
"pupila whose nati/ve language, is other than English who first enter, after grade 
eight, schools where the predominant language of Instruction is English*'. The state 
math tests will be available this year in 22 different languages. The city 'has ini- 
. tiated a-^protedurie o'n'^the writing test which permits students to writer 250,word- 
composition .^o'n s el ect eel topics in their native language. The tests are then graded 
by competent resource people fluent in the. language. This procedure has won appro.val 
from the state add may be instituted state-wide. . 

^Modifjications of state tests and test administration are available for 
students with handicapping conditions. 

Students ^are exempted from State comprehensive, test requirements for gradua- 
tion if they have scored above a cerytain level on College Entrance Examination Board 
tests or American College Testing Program tests or have passed State Regents examina- 
tions in English and math. "Alternative tests" may be used for students "who have 
not passed the examinations .. ..because of extraordinary administrative circumstances 
not caused by the willful act of the pupil or of a teacher or administrator". 

MANAGEMENT OF TEST DATA / 

The district maintains NRT results on tape by year for each student, school^ 
and subdistrict. Hard copy data are also available. The city is also working toward 
a competency test data base for high school students . . The s£udent data base is separ- 
ate and contains no test information. 

The district publishes a three-part Rankings Report which ranks all 
New York City Schools with regard to performance in reading. This report provides 
annual comparisons of the percent of students at or above grade-level, at or below 
grade level, gains, means, medians an^d grade equivalents by school. The statistics 
include limited English proficient students. Although their results are broken out 
.separately, those tested are included in the overall statistics as well. If they are 
hot tested, they are included and counted as below grade level. The third part of 
the Rankings Report (Supplement) excludes data on limited-English proficient students 
Jh4 district ^data base does not allow for analyses by^ gender, race, language or SES. 
/he Rankings Report is released to the general public. ' . ' ' 
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ACHIEVEMENT TESTS (NEW YORK CITY) 



iirade 
Jested 



Name of 
Test 



// Designed" 
by Whom 



Areas 
Tested 



2-9 California Achieve- CTB McGraw- 
ment Test \ Hill 



2-9 Stanford Diagnos- Psych Corp 
tic Hath Test 



K-12 Language Assess- 
ment Battery 



District 



9-12 High School - . Reading - CTBS 
Reading and Math McGraw-Hill , 



series 



9-12 High School 
City Wides 



9-12 Regents 
Exams 



Math 
TASK (Psych 
. Corp) 

^ District 
Subject 
Area 

Directors 



Sta te 



Reading 



Math 



Engl ish Language 
Proficiency 



Reading, Math 



Numerous sub- 
jects in Math, 
Engl ish, Sciences, 
Foreign Languages, 
Business and 
Vocational Ed. 

Math, Languages, 
Sciences, Social 
Studies artd other 
areas 



Metric 
or UM* 



When 
Given 



NCE, grade 
equiv. , raw 
scores , 
percentiles 



\ 

Raw score, 
percentiles 



Pass/Fail 



Spring 



Spring 



Annual ly 
or when 
student 
enters 
system 



Raw scores, Oct 
grade equiv- April 
. alent, per- 
centiles 



Pass/Fail 



Whenever 
students 
complete 
a given se- 
quence 



mr 

CRT 



NRT 



NRT 



NRT 



CRTs 



CRT 



Forms 
Used 



1900 
1981 



Form A 



Al ternate 
forms 



^.'^nns 
Used 



National 



National 



National 



General Pur poses^ 



Annual survey of student adiieve- 
ment; promotion policy inland 7; 
State mandate for ranking of schools 



Diagnostic; Instructional purposes} 
proinotipn criterion in 4 and 7 {0e 
sently being customized to district 
curriculum) 

For placement in bilingual and 
English as a ^second language class 



^Evaluation instrument for funded 
programs 



To demonstrate satisfactory achieve 
ment in courses and sequences of. 
courses, for the requirements of the 
high school diploma 



Achievement test used as a standard 
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MINIMUM C0I1PETENCY TEST^ (NEW YORK CITY) 





urade 
Tested 


Name uf 
Test 


Designed 
by Whom 


Areas 
Tested 


Metric 
or UM* 


When 
Given 


NRT/ . 
\CRT 


. Forms 
. Used 


Norms 
Used 


General Purposes 




3 & 
6 


Pupfl--€va]uatlon 
Program ^ 


State 


Math, Reading 

% 


6th Grade 
Reading V 
DRP* 


Fall 


CRT 






Checkpoints as part of State 
Regent's Competency Test Pro- 
gram 


- 


8 - 


Preliminary 

Competency 

Exam 


State 


Reading ' 
Writing 


DRP* 

Holistic 


Annually 


CRT 




^ _ _ 


Checkpoint to provide remedi a] 
assistance 




9 


Regents 
Competency 
.Test 


State 


Math 


Raw Score 
Pass/ fail 


Oan and 
June 


CRT, 






Graduation requirement 




H 

or 
12 


II '•' 


State 


Reading 
Writing 


DRP* 

Holistic 


M 


CRT 


--- 




Graduation requirement 




*DRP 


- degree of reading power. 




































A 


El 
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Test 1 iaisons" assigned to ea-clji district conduct workshops for principals, 
administrators, teachers and parents on reading printouts and interpretation of test 
results. These \viorkshops are intended to assist in understanding individual written 
test reports, anji how to use these test results. 

C.A.T. subtest results and totals and Stanford math test results are re- 
corded on permanent student records, usually via a gummed label. Teachers, princi- 
pals and immediate school staff have access to these records. 

Longitudinal test data from State competency tests, C.A.T. and the Stanford 
Test have been maintained by student for several years. ^ * 

' The Office of Education Evaluation (research) is distinct from Curriculum 
and Instruction, and is generally responsible for the evaluation of centrally adminis- 
tered, categorically funded and special programs. The Office of Testing in Curriculum 
and Instruction has primary responsibility for test administration but is also 
involved in research design, pilot testing, etc. _ _ 

TEST RESULTS . \ , . ; ; / 

The standards and cutoffs for the competency exams given in high school are 
determined by the state. The standards and cutoffs used on the C.A.T. and math test 
in grades 4 and 7 to determine eligibility for promotion were set in a process initi- 
ated, out of the Office of the Qhancellor. Public meetings were held and committees 
set up. Suggestions were presented to the Chancellor's office which then set the 
policy. Currently, any student in 4th grade who is more than one year below grade 
level in rea^ding and two years\or more below level in mathematics is retained. Any 
7th grade student who is more than 1^$ "years below grade level in reading and two 
years or more below level in mathematics is also retained. 

Students who are retaihed in 4th and 7th grades are encouraged to attend a 
six week remedial summer school program. At the end of the program students are re- 
tested and' promoted if results are satisfactory. Any retainee can be re-tested at 
the end of summer whether or not they have been enrolledM'n a summer program. In 
addition to summer school, remedial assistance is also provided in. special classes 
containing no more' than 20 students. There is no specific policy for high school 
students who- fail the State Competency Test,' 

In addition to summer school and small cl asses , "remedial assistance is 
provided in the regular classroom, and exemplary reading and mathematics programs. 
Some high schools operate before/after school drop-in programs and provide tutorial 
services. Skills labs are available in some of the remedial courses , Remedial costs 
are paid for by the district, state and federal funds, . . , 

If a student scores below the cutoff in 4th and 7th grade CA.T.s, the 
teacher and principal may petition the Superintendent for examptiofi from retention 
based on other grades, past performance and attendance. The petition is presented 
to the Promotional Policy Office where final determination is made. 

Students who do not pass the state competency exam do not graduate even if 
-alT other requirements have been satisfied. Students who do not pass dp not receive 
any certificates or diplomas. They may return in August and January to re-take the 
test but if they have not passed that time, they must pursue a G.I;,D, 
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The .state presently specifies minimum achievement levels for students. No 
legal actions have been taken against the district for the use of any tests. The 
district pays the entire costs of the student assessment program and the scanning,* 
scoring* and- reporting costs o(f the competency exams. , . 

. For* further information on New York's testing program, please coptact: 
Ida Echevarria 

Director, Office of Testing - " 

Division of Curriculum and Instruction . ^ ' 

131 Livingston Street ' • 

Brooklyn, NY 11201 

' Phone: (212) 624-4101 



\ 
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NORFOLK 

The. district uses -standardized achievement tests, published by a commercial 
test service; district-designed achievement tests, and the state-designed minimum 
competency test. 

PURPOSES OF TESTING ' , ' 

• • . ■> ■) ' ■ ■ • 

At both the elementary and secondary levels, "NRTs are used: 

• for program eva^vB^tion 

I for diagnosis of individual str-engths/weaKnesses 

• for. placement of students in remedial classes and the gifted program 

• to measure di strict-wide achievement progress . . 



The CRTs are a factor in promotion decisions at the elementary level and are used at ^ 
both elementary and secondary levels: % , 

• for program evaluation • * 

• for diagnosis of individual students ' ^ - 

• to'' assess the need for curriculum revision 

• to monitor "district-wide achievement progress 

The res,ults of NRTs are also used in the evaluation of federal programs.' 

District-designed tests are referenced against the curriculum and test items 
are matched to curriculum, objectives-. Areas of weaknesses are determined from test 
results at three levels: the classroom teacher .at the class level, the principal at 
the school level , .and the Instruction Department at the system level. Modification of 
curriculum may occur at any of the three levels. 

SELECTION OF TESTS 

• In Virginia, the state recommends and provides speci^f ic^tests.* When an 
option exists,. Testing and- Instruction personnel make the selection. However, tests 
are mandated for specific grades but the district may decide to administer the appro- 
^p.riate level of the test in additional grades as well. 

For district-designed tests, Norfolk 'has developed its'own item pool. The 
tteiDS were generated by test development comm^'ttees which consist of personnel from 
t,he testing department, subject matter coordinators, and subject matter teachers- 
Personnel from the Testing Office served as resource, consultants and provided tech- 
nical assistance. Mastery items can be generated. fur teachers to use in determining, 
if remedial work is effective or mastery of objectives has been achieved. 

TECHNICAL INFORMATION ' - . • 

The district-uses KR20 and the Kappa formula to determine the reliability 
of the Monitor tests and relies on content validity. A study is presently in progress 
_tn rif^i^ inp'if rac ial, cultural or gender bias has been elinjinated. . 
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ADMINISTRATION OF TESTS 



All regular students in designated grades in alT schools are tested. Test 
materials are housed in a testing room, in the School Administration Building, and 
are under lock and key. - . 

ATI test materials are sent to the building principal who must sign a re- 
ceiving form which is returned to the Testing Office. All special requests for 
tests must be approved by the principal and/or Regional Assi stant Superintendent. 
The testing room is cleaned during the day when the testing staff is present. 

- Training on test administration and interpretation of results is given' to 
principals, test chairpersons, teachers and assistant principals for each building by" 
staff from the Testing Office. Prior to the training, the staff meets with Regional 
Assistant Superintendents to present pertinent information. The testing chairpersons 
assist with faculty training. 

'Under specific conditions, a few special education children are exempt 
from the tests. Some special education students take an off-level test. Both the 
state and district tests are available in large print for the vision impaired. Stu- 
dents who^do not test well in large groups can be tested individually. LEP or NEP 
students may be granted case-by-case delays in taking tests but must ultimately take 
them in Engl ish. 

■ ' • 

. MANAGEMENT OF TES T DATA 
— ■ ■ ■ - ^ - ^ 

All information from the Graduation Competency Tests and district Monitor 
^Test's is on the test data base keyed to individual student I.D. numbers. The data 
base also contains information, on each student's grade, sex, race, and ^school . Re-^ 
suits from the CAT and SRA tests are on separate tapes and cannot be accessed by 
student. I.D. number. From the test data base, for the Monitor Test, the district 
generates item analyses, frequency distributions and summary statistics by class, 
school and system. Reports. on individual students and^.classes are sent to teachers. 
Aggregate class data and school reports are provided to principals. Formal reports 
on individual schools, schools in a region and system are provided to principals, 
. Regional . Assistant Superintendent, Superintendent and the School Board. 

o 

' Parents are issued individual reports with an explanation of content. A 
cover letter from the principal is written., urging parents to contact teachers for an 
explanation and assistance, when necessary. The->Testing staff also provides test and 
test interpretation information at PTA meetings upon request. 

Elementary students'' records contain a computer generated sticker showing 
test-date, scores for each subtest and total. Graduation Competency Test subscores 
^ and pass/fail status\re recorded on each secondary srtudent' s foldeV. Access to stu- 
dent records 1s limited to classroom teachers, couj&^lors and parents. Individual 
student records are microfiched after graduation and maintained indefinitely. 

The Researc'h and Instruction Departments are support departmefits. They work 
together but do not report to the same Assistant Superintendent. The Director of ^• 
Testing is in char_ge pf->test administration. . ^ v 
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ACHIEVEMENT TESTS (NORFOLK) 



Grade 
Tested 


Test 


Designed 

by Whom ^ 


Areas 
_ Tested 


— n — I — » 

"Metric 
or UM* 


When 
Given 


NRT/ 
CRT 


Pre-K 


Monitor Test 


District 


Readiness 


Percent 
correct 


Sept 

Jan 

May 


CRT 


K 


Metropol Itan 
Readiness Test 


Psychological 
Corporation 


All six , 
areas 


Percentile 


Feb 


NRT 


1 






M 


II 


Sept 


NRT 


1 


Monitor Test 


District ' 


Language Arts 


Percent 
correct 


Jan 
May 


CRT 


2 


Science Research 
Associates Test 

0 


Science Re- 
search Asso- 
ciates, 
Chicago 


Language Arts, 
Math, Reading, 
Educational 
. Ability 
Series 


Percentiles 


Mar 


NRT 



6, 8 



Science Re«-.parch 
Associates 
Achievement Test 



11 



1-6 Monitor Test 



Science Re- 
search 
Associates, 
Chicago 



District 



Reading, Language 
Arts, Math, Social 
Studies, Reference 
Materials, Educa- 
tional Ability 
Series 



All of the above 
and Applied Skills 

Language Arts and 
Math 



Percent 
.correct 

\ 



Mar 



Mar 



NRT 



NRT 



Mar 



^Sept, Jan, CRT 

Ma>x, 



Forms 
Used 



Norms 
Used 



Local 
National 

M 

Local 
National 



Form P 
Level I 

Form P 
Level II 



Level C 
Form 1 



Level E 
Form 1 



Level F: National 

Form 1, 6th 

Level G: 

Fomi 1, 8th 

Level H: 

Form 1, nth 

V National 



different Local 
levels according 
• to grade 



General Purposes 



To assess readiness for Kinder- 
garten 



Diagnostic 



To (iioni tor progress 

To determine degree of achievement 

/ 

/ 



To determine degree of achievement 



To deteniiine degree of achievement 
To monitor progress 
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Norfolk - Achievement Tests Cont^d 



brade 
Tested 


Tost 


Dp s i nnpH 
by Whom 


Areas 
Tested 


Mo ^ V* i f* 

or UM* 


When 
Given 


3-8 


California Achieve- 
ment Test 


CTB McGraw- o 
Hill 


Reading, Lan- 
guage, Arts, 
Math 


Percentile 
NCE 


Oct 
Apr 


7 


Science, Math, Lan- 
guage Arts Tests 


District 


Science, Math 
Language Arts 


Percent . 
correct 


Sept 
Jan 
Feb 
May 


8 


Math, Language 
Arts Tests 

\ 


District 


Math, Language 
Arts 


Percent 
correct 


Sept 
Jan 
Feb 
May 


9&10 


Math. )\anguage 


District 


Math, Language 
Arts 


Percent 
correct 


. Feb 


i n f. 

i 12 


Language Arts 
Tests 


District 


Language Arts 


Percent 
correct 


Feb 



1 • 
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NRT/ Forms Norms 

CRT Used Used General Purposes 



NRT Off-level National For Title I 

Testing 



CRT — Local To monitor progress 

c ■ 

i . 

CRT — Local To monitor progress 

CRT — Local To monitor progress 

CRT Local To monitor progress 



.1 - J t 



.1 



MINIMUM COMPETENCY. TESTS (NORFOLK) 



urade / 
Testerf 



Naiiic of 
Test 



}0 Virginia Gradua- 
' tlon'Test 

11 » Virginia Gradua- 

12 tlon Test 



Designed 



Area? 
Tested 



State 
District 

For those 
who did not 
pass test 
in loth 
grade 



Reading, Hath, 
SociaT Studies 



Metric 
or UM* 



Percent 
correct 

nth Grade: 

March 
12th Grade: 

Oct., 

Mar., 

May 



When 
Given 



"NRT7" 
CRT 



Forms 
Used 



Norms 
Used 



General Purposes 



March 



CRT 



State 



To determine graduation 



ERJC 
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TEST .RESULTS - \ • 

The state sets the .standards for passing minimum competency bests . Students 
must score 70% correct to pass. In 1981, 99.9% of the 12th grade students, passed. ' . 

Those who fail competency tests^on the ,f4rst administration hav^e four oppor- 
tunities to retake the tests. Remedial work is provided in each school. \Remedial , 
work can take the form of assistances in the regular classroom, enrollment in remedial 
courses or tutorial assistance, all of which. is paid^for by the district. \ 

Test scores are only one of majiy criteria in\romotioh decisions, yeacher . 
judgement, reading level, grades and clas'^room participation are also factorsX How- 
ever, students must pass the competency tests to graduate ' irrespective of other cri- 
teria. • Regular students^ who do not pass, do not receive a diploma. They do have the 
opportunity to return and take the tests after leaving school. \ 

Both the district and state presently specify minimum achievment leveA. 
The state supplies the manddated tests and pays for scoring and other costs. | 

For further information on Norfolk's assessment -program, contact: :^ / 

Anna G. Dodson - ^ . ' 

. Director of Research, Testihg 

and Statistics 
i 800 E. City Hall Avenue 

Norfolk, VA 23501 . 

Phone: (804)* 441-2319 
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OAKLAND 

The district uses standardized achievement tests published by a 
commercial testing. service, and district-designed achievement and minimum com- \ 
petency tests. 

PURPOSES OF TESTING 

Both NRTs and CRTs are used a*^ the elementary and secondary levels 
for: ; 

•^program evaluation 
I pla'cement of students 

• diagnosis of individual student strengths/weaknesses . 
9 assessment of th^- need for curriculum revision 

• measurement of district-wide achievement progress 

I determination- of the need for .teacher in-service training 

In addition, NRTs and CRTs are a factor in placement of students in; remedial 
classes at the elementary level and CRTs are a factor in promotion decisions at 
the elementary level. Results are also used in the evaluation of federal pro- . 
grams . 

The, student assessment program is not related to curriculum improvement 
efforts through any formal process. Test results are reported to the Curriculum 
Division at least semi-annual ly and the curriculum is written based on test 
scores. 

SELECTION OF TESTS 

Tests are selected by the Superintendent's Testing and Evaluation 
Committee which is comprised of the Director of Research and Evaluation, several 
principals, teachers, curriculum perspnnel , parents, and one representative from 
the community at large. Test pub! i shers deal directly with the Director of 
Research and Evaluation and his staff which presents test materials to the . 
committee for review and selection. • . ' . ' 

When the district designs its own tests, it develops some items on its 
own but also draws on item banks such as the state item bank, the National 
Institute of Education National Assessment pool in Denver (Education Committee of 
the States), and publishers' existing item banks for which a royalty must be paid. 

TECHNICAL INFORMATION . 

To ascertain reliability of district-designed tests, standard relia- 
bility formulae, primarily KR20 arid KR21 are used. Validity is assured by content 
validity determined by an Item Review Committee using item bias studies. To 
preclude cultural, racial or gender bias in test items, statistical item bias 
stL^ies using primarily Chi Square and item response theory are conducted. 
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ADMINISTRATION OF TESTS 

An students in all schools are tested with the exception of California 
As'-sessment Project, which ^uses matrix sampling. There are ten forms of the^ test 
•'and students take one of the ten. Only school scores are available. All testing 
is conducted within the students' schools. 



. The LEAP and CAP tests. are numbered sequentially, 
and returned by teachers and principals who are responsible 
the schools. 



for 



hey must be signed out 
their security in 



Occassional workshops on test administration are held for faculty but 
there is no organized approach. 



Proficiency standards for handicapped children are 
the Individual Education Plan. Non-English proficient st 
m tests. State law, however, requires that the LEAP 
ilish: ' 



in 

from tests 
Engl ish 



set individually 
stuc ents .a.re.^]sxempt 
be taHen and" passed in 



MANAGEMENT OF TEST DATA 

The district's test data base and student data base are identical. A 
centralized system maintains raw test .scores' for each student. Any statistical 
measurement can be produced by accessing all. members of specified group (grade 
level, classroom, school, gender, race, language) and converting' raw scores. 

The district produces thirty to forty reports on test results by pro- 
gram and/or school to various categories of people and groups. 

Assistance with test result interpretation for teachers and parents 
is provided by Evaluation staff, Eath staff member is assigned to a specific 
number of schools to work with teachers and conduct Workshops and In-service- 
training. A one sheet Individual Student Report which is sent home to parents 
Includes interpretive information. Evaluation staff also attend School Advisory 
meetings where they talk to parents. 

All information, raw scores, from subtests are placed on student 
records. Central administrators, principals, teachers, counselors and students 
have access to the record$^^ 

Test data for the oo strict and schoolshave been maintained format 
least 20 years. The data basK^by student is two years old and will be maintained 
indefinitely. 

The Research Department acid curriculum and instruction are separate 
units although both report to the same Superintendent. The Director of Rese.arc^ 
and Evaluation is responsible for test administration. ' 

TEST RESULTS 

The schools in the district operate voluntary programs to prepare 
students for tests outside of regular classroom instruction. " • 
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ACHIEVEMENT TESTS (OAKLAND) 



brade 
Tested 



Name of 
Tost 



Kindergarten 
Check List 



1-12 CTBS 



,Cal ifornia 
Assessment 
Program (CAP) 



6&12 



Designed 
by Whom 



District 



CTB-McGraw- 
Hill 



State of 
Califqrnia Dept, 
of Ed. 



Bilingual 

Syntax 

Measure 



3, 5. Learning Expecta- 
7, 9, tions and Profi- 
le ciencfes (LEAP) 



English 
familiarity 
skills as- 
sessment 



District 



Areas 
Tested 



Number and 
Letter Rec- 
ognition 

Reading, Lan- 
guage, Math 



Basic Skills 
Survey 



Reading, Written 

Expression, 
Math 

Reading, Written 

Expression, 
Math, Spelling 

Number correct 



Metric 
or UM* 



When 
Given 



NRTT 
CRT 



Forms 
Used 



Norms 
Used ' 



General Purposes 



Number Fall 
Correct 



CRT 



Spring NRT 



Standard 
Scores, per- 
cent grade 
level equiv- 
alent 



Percent ' Varies NRT 
items correct 



Standard ' " NRT 

Score . 



Percent items " NRT 
correct 



Form S 



Form 2 



Reading, Math, 
Language 



MINIMUM COMPETENCY TEST 

CRT Form 2 



Item response March 
Standard 
Score 



Initial placement in Kindergarten 
classrooms 



PublisherJ^^s Achievement progress. Individual 
National student diagnosis. Curriculum de- 
Norm 19^6 \ ye.lopment 



State State assessment and legislative 

mandate 



State State assessment and legislative 

mandate 



State State assessment and legislative 

mandate 



Administered to all students whose 
native Language is not English when 
they enter school system to assess ' 
ability to speak and comprehend 
English 



District Individual diagnosis, curriculum de- 
velopment, retention/promotion deci>- 
sions. Students in grades 9-12 must 
pass once, Graduation requirement 
effective 1981. 
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The' standards for passing minimum compet^cy tests were set by a 
committee of approximately 50 people including administrative personnel, ^princi- 
pals, teachers, students and community members. Each area tested contains a • 
number of competencies. Students must demonstrate mas-tery of 70% of all compe- 
tencies. Only 1% of 12th graders were not able to, graduate in 1981, the first 
year test was required for graduation, solely on the basis of. failing the com- 
petency test. , . ^ • 

The district offers remedial assistance in the regular classroom, 
remedial courses, a before/after school drop-in program, summer sQho'ol , tutorial 
assistance and skills labs for which it pay all posts. Students must pass the 
competency test to graduate even if all other, requirements t;iave been satisfied.* 
California law prohibits awarding any special diploma or certificates to students 
who have not passed the test. Students have the option of .attending adul t school* 
or a community college program after leav,ing school.* A remedial course is also 
offered to 12th graders who do not attend school ,,cind may or may mot .have completed 
.other high school requirements.. • . ) 

When deciding whether or not to promote a student, CTBS scores, dis- 
trict CRT tests, subject grades, teacher judgment and a number^of other factors are 
considered in addition- to competency test scares. -n ' " Ii 

The district has specified minimum achievement levefs for Itddents under 
state mandate. No legal actions ha.v.e beefn taken against the district for using any 
-tests but several cases are pending against the state.. The district pays the en- 
tire cost of the assessment program. 

For further information on Oakland* s testing program, please contact:. 
Dr. Stephen Osterlind 

Director of Research and Evaluation ^ ' . 

Oakland Unified School District 
1025 Second Avenue 
Oakland, California 

Phone: (415) 836-8253 



PHILADELPHIA. 

. . The district, uses standardized achievement tests pu^^blished by a cimmer- 
cial testing company and both district-designed achievement and mi nimum .competency 
tests. ' . ■ 



PURPOSES OF TESTING . ^ ^ ' ' , 

.Both NRTs and CRTs are used at the eVementarx and secondary levels: 

/ 

• for placement students 

• for diagnosis of individual student strengths/weaknesses • % ^ 
^9 to place students in remedial classes a \ " 
I to assess the need for curriculum revision 

• to determine the need for feacher in-service training 

NRTs are also used at elementary and secondary levels, for program evaluation and to . 
vmeasure district-wide achievemeht progress. Test results are also used in the eval- 
'uatlon of federal .programs . ^ ^ 

A 

Tests are referenced against the curriculum. Data on item performance- 
are^ given "to the Curriculum and Instruction office which conducts comparisons and 
analyses to identify curriculum -areas which may require modification. 

^SELECTION OF TESTS ' > ' . . . ' 

The district has no standing test review committee. When requiredv the 
research office and all other/off i ces concerned are-involved. Using an extensive 
review procedureT materials from test publishers are^ evaluated. Responses from 
the review process are analyzed and consensus reache^'d on- the final selection. No 
competitive ^bids are obtained. (A qopy of 'the forms used in the review process is 
available attheCGCS). After the test has been selected, it js field tested with 
representative students at different levels. Both objective test results and 
affective domain responses are analyzed and evaluated prior to fir^al test implemen- 
tation. . 

The district does not use item ba.nks or pool. .Items for cTi'strict- 
designed tests' are develop.ed- by personnel from , the appropnlaie^curricul um office. 
All Items are piloted and statistical analyses conducted to determine which will 
used . . ' ^ 

TECHNICAL INFORMATION . ,. : 

'Reliabi'l i'ty of the district-designed reading test was determined by usihg 
\lnternal consistence estimates (KR20) whioji resulted in a measure of .94. 'No re- 
liability tests have^been conducted .far the math tesfs. Validity on the district- 
designed tests. 1s assumed from the test development process Mn the curriculum de- 
partment. No formal provisions. have 'Been made to protect against cultural, racial 
or gender. bias. However, items are carefully considered from these perspectives . 
Item try-outs are used -to detect bias. 



\ 
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ADMINISTRATION OF TESTS 



the 



All, 
students ' 



students in all schools are tested and all testing is conducted in 
schools. All tests are stored in the schooT'S-:and test security is 



the responsibility of each school's administrator . ^ Training .on test procedure 
•for faculty , is provided in. written form by* the central office\for implementation 
at individual schools. " . \ 

• ' ■ \ 

Only' -mentally retarded students in self-contained classrooms are exempt 
^-fRom the di^rict's competency tests. Teachers use their discrSition about the 
method of administering the tests to handicapped students but 'alll must take them. 
The' math test exists in a Spanish edition but the reading test must be- passed in 
English. ' - ' ' ' 



MANAGEMENT OF TEST DATA 



I. 



The district maintains' a pupil directory filewith individual demographic 
data. No test results are on this student data base butNRT re'sults can be 
obtained for individual .students by cross-walking with student/identification 
numbers. Competency tests are school administered and there is no central test, 
data base for-th'esa results,. The district reports, class lists with pass/fail in- 
dicatio-ns including results- by subtest and class summaries. /Analyses of the 
competency ^test are done by school only. ', < ' ■' , 

Class score lists are sent to schools through the/ Curri cul um office. A 
year-to-date recapitulation of reading resu'lts is also produced. 

The type of assistance given to teachers and parents on test result inter 
pretation is a local school option. CRT results aife pn- student report cards with 
a pass/fail notation' al all other subjects. Competency/tests results are not re- 
corded on 'students ' permanent records. The data are ma/intained >^r~to-date only. 

The research department and curriculum and-instruction^^are-cooperating 
colleagues. Curriculum and Instruction is in charge ^f test administration. 



TEST RESULTS " • ■ - 

< /■ ' 

• The standards for passing the minimum competency test were set by the 
Curriculum department based on standardization data provided by Research and 
Development. '• 

, • Students who do not pass the minimum competency test are automatically^ 

placed i'n remedial courses held during regular school hours. Remedial assistance 
is also available in the regular classroom. In addition to test scores, report 
card grades and teacher recommendations are factors in promotion decisions at the 

'elementary and iunior high levels. Students are provided numerous oppytumti es_ 
to pass the minimum competency test but it must be passed to graduate ^en if all 
other requirements have been satisfied. Students who do not pass are awarded a 
certificate of attendance instead of a diploma. 

-9 - . ' . . ' •■- .- . 

There have been no legisl-ative measures proposed which would specify 
minimum achievement levels. and no legal actvions have been taj<en asainst^the dis- 
trict, for tVe>se of any tests, the dTstric\ pays the entire cost of the student 
assessme,nt program. 
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ACHIEVEMENT TESTS' {PHILADELPHIA) 



\ 
\ 



urade 
Tested 



Test 



Designed 
by Whom 



Areas 
Tested 



2 
3 
4 

5 ' 

6 

7 

8 

9 

II 



Metric 
or UM* 



Stanford 
Early School 
Achievement 
Test 



California 

Achievement 

Tests 



Psych 
Corp 



CTB/McGraw- 
H111 



Complete NPR 
Battery 



•Reading 
Mathematics 
Language 



When mi/ Forms Norms" 

Given ' CRT Use-1 . Used 



February NRT 



Reading " 
Mathematics* 

Reading " ' " 

Matiiematlcs* 

Reading " 
Mathematics* 

*In Title I eligible schools only 



Level 1, 
Form A 



Level 1,. 
Form A 

Level 2, 
Fomi A 

Level 2, 
Form A 

Level 3, 
Form A 

Level 3, 
Form A 

Level 4, 
Form A 

Level 4, 
Form A 

Level 4, 
Form A 

Level 4, 
Form A 

Level 5*^ 
Form A 



^ G e neral Purposi.'S 

"For all Oracle s: 
Mid-Year Annual status report of pupil per- 
formance in basic skills guidance, 
placement, program evaluation, eligi- 
bility for Title I services, Instruc- 
tional diagnosis, etc. 
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Philadelphia - Achievement Tests Cont'd 



Urade 
Tested 



Designed 
by Whom 



Areas 
Tested 



Name of 
Test 



Metric 
or UM* 



When 
Given 



NRT7" 
CRT 



12 



Cal 1 fornia 
.Achievement 
Test 



CTB/Mc6raw-Hil1 Reading 

Mathematics* 



NPR 



Febraury NRT 




*In Title I eligible schopls only 



Forms 
Used 



Norms 
Used 



General Purposes 



Level 5, Mid-Year For All grades: 

Form A Annual status report of pupil 

performance in basic skills — 
guidance, placement, program 
evaluation, eligibility for 
Title I services, Instructional 
diagnosis, etc. 
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MINIMUM COMPETENCY TLSTS - PIIILADrLPfllA 



Tested 



Name of 
Test 



Assessment of 
Hath Literacy 



10 Assessment of 
Hath Literacy 



Designed 
by Whom _ 



ITreas 
Tested 



Metric 
or UM* 



When 
Given 



CRT 



Forms 
Used 



Math Dept. Mathematics 

aided by 

Research 

Office 

Math Dept. Mathematics 

aided by 

Research 

Office 



Raw Score Offered CRT 
Feb ft 
May* 



Raw Score Offered CRT 
Feb R 
May* 



Grade 8 



Grade 10 



Nonns - 
Used 



General Purpose s 



To establish partial eligibii^ty 
for M.S. diploma. 



To establ ish, partial eligibility 
for M.S. diploma. ' 



10 Functional 
Literacy 
Assessment 

■ r 



Language 
Arts Dept. 
aided by 
Research 
Office 



MINIMUM COMPETENCY - READING 



Reading 



Raw Score Offered CRT 
Oct. & 
May* 



Grade 10 



To establish partial eligibility 
for H.S. diploma. 



12 , " Reading Raw Score Offered CRT Grade 12 

Oct. , 

Dec , , N . 

Mar. & 
May* 

*Each pupil is expected to pass one Reading test in either Grade 10, 11, or 12. Once passed, the test Is not retaken. 



To establish partial eligibility 
for H.S, diploma. 
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f6> further information on Philadelphia's testingsprogram, contact: 

Dr. Jules Grosswald ' 
Di rector 

Division of Testing Services 
Board of Education Building - Room 407 
21st Street and the, Parkway 
Philadelphia,. PA 19103' 



Phone: (215) 299>7745 



\ 




I 



\ 
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PITTSBURGH 



The' district uses both standardized achievement tests published by a 
CQHimerclaT testing seVvice and- district-designed achievement tests. 

PURPOSES OF TESTING 

NRTs are used in 'grades 1-8' for program evaluation, diagnosis of indivi- 
dual student, strengths/weaknesses and to measure district-wide achievement progress. 
At the secondary level, NRTs are used for placement in remedial courses. CRTs are^ 
used for diagnostic purposes. ^ The results of tests are not used in the evaluation 
of federal programs. 

there is a revolving, reciprocal process between the assessment program 
and curriculum improvement efforts. The curriculum is ' periodically reviewed, and 
if changes are made, then tests are modified to refl ect these. 

SELECTION OF JESTS . • ' ^ 

Tests for the district are sel ected . by an ad hoc committee ofTa^cademic 
supervisors and counselors. The cominittee examines specinl^j^sets from puibl ishers 
and may request presentations. A detailed rating form which ranks tests o^n the' 
basis of validity, appropriateness for students, administrative usability and 
technical excellence is employed in \he selection policy. (Copies of the Test 
Evaluatioh Rating 'Form are avai 1 abl e '^^at the Counci-1 of. Great City Schools) 

TECHNI CAL INFORMATION A " V 

No determination, of the reliability of district-designed' tests has been 
made. Content validity is assumed through the development of test items and 
objectives, which reflect course and text objectives. No analyses have been con- 
ducted to determine if cultural , racial or gender bias has been avoided. 

ADMINISTRATION OF TESTS \ , , 

All students 'in all schools are tested in the students', schools-." Prin- 
cipals are responsible for test security but no formal procedures exist. 

Principals and academic supervisors receive instruction and guidance to 
conduct In-service training for faculty on test administration a'nd interpretation of 
test results. Written documents of instruction are also proivded for teachers. 

" f ' Educable Mentally Retarded ,and non-English proficient students are 
exempt from tests. Large print is ayaila-ble for vision-impaired students. 

MANAGEMENT OF TEST DATA 

The district has centralize'd data on tapes from scoring services for the 
NRTs by student and. school. Si nee, the Moni tori ng tests are still in the process 
of evolving, the results are not presently maintained on tape. The student da^a 
base is independent of the test data base. From the NRT.raw scores, the^distritt . 
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_ Co/ , ■ ' 

can generate gra,de equivalents, national percentiles, stanines, summary statis- 
tics and the number of students above and below national norms. ^ In addition to 
analyses by school, the data base also allows for analyses by gender! Achieve- 
ment ^data by school and for district is sent to the Board o,f Education and made 
public by that body. - « 



Parents receive a Student Interpretive Report on test scores sent 
home with the report card. Each report contains a narrative unique to the student 
which fs norm and criterion referenced and discusses the student's strengths and 
weaknesses in each area tested. . ' ^ , 

All standardized achievement test data are placed on student records 
by a computer printed label. School' personnel, parents and students over 18 . 
have- 'access to the records. Both the student records and taped test results are- r 
maintained indefinitely.. 

The district does not have a Research Department. The Division of Testing 
and Evaluation and the Division of Curriculum Development are independent but under 
thfe Department of Instructional Development. Classroom teachers at the elementary 
level and counselors at the secondary level are in charge of test adni.inistrarion. 

TEST RESULTS " . , . 

The Basic Skills Assessment -is used by the district 'as a minimum compe- 
tency test. The standards and cutoff are determined by all English and math 
teachers at the secondary level using the Nedelsky and Angoff methods . In reading, 
student must score 44 out of 55 and in math 31 out of 70 (standard scores of 134). 
Approximately 87% pass, reading and 72% pass math. 

Those who do not pass the test, which is given in November of the 10th 
grade,. are placed in a remedial course. In- addition to normal graduation re- 
quirements, ^his course must be passed before the student can graduate. The course 
is also available in summer school. The district pays for remedial work. No 
special diplomas or certificates are awarded to those who do not pass the test or 
course. 

• With respect to promotion decisions, individual teachers determine if 
tesf'scores are to be a factor in the decision and how much weight they are to be 
given. 

Neither the district nor the state presently specifies minimum achievement 
levels. No legislative measures of this nature have been proposed. The district 
pays the entire cost of the assessment program. 



contact: 



For further informatiofi'^on Pittsburgh's assessment program, please 

Melvin Vesely ' . 

Testing Speciial ist 

Pittsburgh/Public Schools ^ ^ \ 

341 South/Bel lefield Avenue 
P/it1;sbur^h, PA 15213 

Phone/ (412) 522-3941 



ERIC 
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ACHIEVEMENT TESTS (PITTSBURGH) 



lirade 
s cp a_ _ 


Name of 
Tost 


Designed 
by Whom 


Areas 
Tested 


Metric 
or UM* 


When 
Given 


CRT 


Forms 
Used 


Norms 
Used 


General Purpos'js 


K 


School Readi- 
ness Survey 


Consulting 
Psycholo- 
gists 


Visual, 
Audio Discrimi- 
nation, Genera] 
Reading, Lan- 
guage, Matn, 
Spelling, Refer- 
^ence Skills 


Raw 
Score 


Sept 


CRT 






Establish joint parent/school effort 
in education of child 


K - 8 


California 
Achievement 
Test 1977 
Edition 


CTB/McGraw- 
Hill 


Reading, 
Language,. Math, 
Spelling,' Refer— ^ 
ence Skills 


Raw Score 

Grade equiv 

alent, 

National 

percentile 

National 

Stanlne 


April 


NRT 


Form C 


National 


Assessment of achievement. Diagnosis 
of individual student strpnafh«:/wpak. 
nesses 


1-8 


Monitoring 
Achievement 
in Pittsburgh 


District 


Math 

s 


Raw Score. 


6 times 

per 

year 


CRT 


Forms A-F 




Diagnosis ' 


\ 1-12 


Hon i tori ng 
Achievement 
in Language 


District 


Grammar 
and Composition 


Raw Score 


Begia 
Pilot 
Test 
Jan '82 


CRT . 


: — 




Diagnosis 


1-2 


r ion i to ring 
Achievement 
P«ad1ng 


District 


Reading Skills 


Raw Score Will be 
y implemented 
^y^Sept '83 


CRT 


— - . 


— 


Diagnosis 


5, 8, . 
11 


^ Pennsylvania 
Educational 
Quality Assess- 
ment 


State / 


Reading, Math, 
Language, Health 
and other non- 
cognitive areas 


State i 
percen- \ 
tiles, } 
ranks 


M^ch 


CRT 


^— - 


State 


To 'measure school perfonnance In 
tested areas 

\ 


9 Moni toring Arhlevenient 
in Pittsburgh , 


District 


General Math 


Raw Score 


Six times 
per year 


CRT 


Fonns A-F 




Diagnosis ' . 

1 


12 Monitoring Achievement 
in Math 


n 


Consumer Math 


It 


If 


u 


It 
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The distriirt *uses both district-designed" achievement and minimum com- 
petency tests. The NRT/CRT distinction does'^not apply to the district's testing 
program which is designed to incorporate' the best of both NRT and CRT approaches. 
The district reports individual scores and group'means in relation to local and 
national norms,' but also reports student success or need for help on each of the 
specific goals measured within the program. • I 

PURPOSES OF TESTING ^ ' / . 

Tests are used /for 

• program evaluation ' / - ' 

• placement /of students . ' ' . 
% diagnosis/ of individual student strengths/weaknesses 

• placemen/u of students in remedial classes 

• assessment of the need for curriculum /revision 
I measurement of district-wide achievement progress 




The results are also used in the evaluation' of federal 

Tests are developed to closely mat^sh the local curr-icu-lum. Results' / \ 
are used at district, building and classroorp'^J-eVel s to select, revise, improve a/nd ' 
adapt curriculum goals as well as instruc>tonal materials arid practices. 

' . . ' / 

SELECTION OF TESTS : / 

■ ,/ ■ 

.. ■/ 

; The district has a standing teS't review committee comprised of key 
evaluation and curriculum personnel advised by building staff who. consul t citizen 
.advisory committees. The district no longer deals with test publishers except for 
special, limited purposes. When designing its own tests, the district draws on 
the Northwest Evaluation Association item banks to which it a^so contributes. 

TECHNICAL INFORMATION '^^ ' ■ 

The reliability of districtrdesigned tests is de,termined by using split 
halves and test-retest methods. " More importantly, reliability is measured by- 
indicators of 'the measurement error Velated to each score on- each test. 

To assure validity. Curriculum establishes goals and certifies the ap- ' 
propriateness of goal coverage. Items are reviewed for match with required cur- 
ricul^j^ and instructional materials and'comparisons are^made with other local, 
state and national measures. . . 

Item bias has been precluded by having each item reviewed by a multi- 
cul tural-ra'cial-gender committee prior to field testing.. Each item is reviewed 
against carefully developed and public criteria. After field testing, item 
/analyses are reviewed to determine, how each one performs with different groups. 
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. ADMLNISTRATIOfi.OF TESTS . . • ^ - ' 

t r — n 

* All students ingrsdes 3-8 and- al P secondary students who have not yet 
attained the district criterion levels for ^ competency certification are tested. 
All testing is conducted within students ' '.school s. Tests are^ numbered and signed 
out. They are kept under lock and key until after testing. 

' Teachers and administrative staff ^v/ho administer tests receive spiecial 
^ training on testing procedure^and'' local building test, coordinators provide support 
ahd information^ . ' * * . ^ * 

' Any special'^students^ who cannot, take tests are exempt .from !them. Accom- 

modations are being developed to incl^ude as^many handicapped students! as can bene- 
fit from testing. Similar adaptations- are planned. for non-English speak-ing , 
students at least in mathemafics. ^ ' ' • * . . 

,4 "' MANAGEMENT OF TEST DATA . , ' ' ' . -'^^ ^ , 



' The' ^iistrict maintains a longitudinal test data base keyed to unique 
student 'J .D. number that includes scores bacis; to 1977, and additional student 
data such' as schools attended, age, raca, sex, special programs, etc. Further 
student data -is accessible. The data" base al so allows for analyses by school, 
language and SES to some extent. The system reports Rasch analyses, calibrations, 
linking, and "scoring. The entire, test data base is maintained until five years 
aft^r students leave the system. . ' ' 

The annual level of achievement and gain is reported' to -the school 
board, central and area' administrators, building administrators, program 
managers, teachers, students and parents, by grade'and subject, within district, • 
area, building, program, classroom, teacher, and indi^?idual student as appropriate. 

. X Teachers are given assistance wi±h testresult interpretation through 
in-serv'ice training as well as manuals and brochures. Assistance is also pro- 
vided by principals and test coordinators. Parents are assisted thorough a -Parent- 
Teacher Guide, which is a 180 page test informatidn manual , and in conference with 
teachers. Individual computed generated reports of the level of student achievement 
and goal areas in which students need additional help are sent home. 

' Twiceo annual achievement data and Certification of competency att^ainment 
are noted on student records. iTfeachers have •Recess to these records as needed^ with 
the consent x)f principals. Other authorized district personnel ^alsq have access. 

vThe evaluation department and the curriculum and inst^uction unit are 
Gooperatirif-Col leagues. A Curriculum^-^nd Evaluation Council meets monthly to foster 
mutuaf support. The Ei^aTuation Department is responsible for test administration. 

TEST RESULTS ^ ^ ^ . ' ^ ^ . > 

- ^ . .* . 

The district standard for passing, minimum competency tests is a ^'ninth 
grade national equivalent" which was adapted by the Board of Education. The class 
of 1984 wil^ be the first class for which the competency test "will be a graduation' 
requirement.. Currently, approxim'ately 20-30% are below certification levels as of 
'their sophomore year. . . " : " - 



-133- i77 



ERIC 



\ ACHIEVEMENT TESTS (PORTLAND) . 



urade 
Tested 



Name of 
Tost 



Designed 
byWhom 



Areas 
Tested 



Metric 
or UM* 



When 
Given 



NRT/ 
CRT 



Forms 
Used 



Norms 
Used 



fipncral Purpose's 



3, 4, 
5, 6, 
7, 8 



Portland Basic 
Skills Achieve- 
m<?nt Levels 
Tests 



Evaluation and 
Curriculum Staff 
of PPS in, con- ' 
sul tation wi th 
Consultants, 
teachers, Prin- 
cipals, Coun- 
selors, etc. 



Reading . 

Mathematics 

an^ 

Language 
Usage 



Local Oct and Both Alternate Equated to a Provide accurate individual mea- 

Stctndard May forms of variety of sures of achievement each Fall and 

Score locally o National Spring expressed-^ in terms of (1) 

developed, Norms position on a Rasch equal -interval 

Nortfiwest functional scale extending from low 3rd grade 

Evaluation level, Rasch . to high 8th grade performance and 

Asspciatioh based, stan- (2) a standard score based on 

Rasch Scale , dardized . Portland grade-level distributions 

I tests 

Indicators Identify goals on which individu- 

by Goal if ' als or groups of students may need 

between further' diagnosis and help, Stu- 

District . ' dents grouping instructional pri- 

niean and orlties. Student I acement, 

16th per- ^ . Program Evaluation, Policy For\ 

centile (4) " . ^ mulation. Resource Allocation, ^ 

and if below Research 

16th percen- ^ ^ 

t^le (R) ' Provide semi-annual information 

, * on progress \of' students toward 

basic skill s'tiigh school gradua-^ 
' tion requirements 
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MINIMUM COMPETENCY TESTS (PORTLAND) 



Urade 
Jteisted 



Name of 
Test 



Designed 
by Whom 



AVyCas 
Tested 



"Metric 
or UM* 



1 When 
\ Given 



NRT/ 
CRT 



Forms 
Used 



Norms 
Used 



\ General Purposes 



• \ 
\ 

(Note: The grade 3^8 Achievement Tests cover the same 
goals as the end of Bth through IZth* grade Minimum Com- 
petency Tests, and reports on whether students are 
making satisfactory progress toward eventual certifi- 
cation are among the reports provided twice .a year be- 
ginning in the 3rd grade. 



/ 



8-11 Portland ^ Ditto Ditto 
Graduation 3-8 3-8 

Standards Achievement Achievement 
Tests 



Ditto 
3-8 
Achievement 

Plus 
whether 
score is 
above dis- 
trict stan- 
dard (9Vi 
grade 
national 
average) 



Ditto 
3-8 
Achievement 



Ditto 
3-8 
Achieve- 
ment 



/ 



Multiple 
al terna te 
forms 



Ditto oUto 
3-8 3-8 

Achieve- Achievement 

ment Plus 

Certification for Graduation Attain- 
ment of levels of Basic Skill Com- 
petencies 



r 
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students identified as needing special help receive 'it in and out of 
' the classroom, Remedial . work may take the form of speciaV courses, before/ 
after school drop-in programs, summer school, tutorial assistance and skills 
labs.'. Local buildings determine which forms .are most suitable and the work is 
' paid for with area and central support. 

Promotio'n decisions are up'to principals who consider social development, 
behavtor and' other indicators of achievement in addition to test scores. Teacher 
/ and other professional judgment together withother indicators of achievement „ 
such as classroom performance are also factors in decisions to place a student for 
remedial work. ' ■- - \ 

As of the class of 1984, students must pass th^ Portland Graduation, \ 
Standards Test to graduate even if all other requirements have been satisfied.\ \ 
Students who do not pass, may receive a special diploma or certificate of atten-XJ^^ 
dance and/or competence. 

For further information on Portland's testing program, please 
contact: | 

Dr. Waltej" E. Hathaway 
Evaluation Department 
501 N. Dixon Street 
Portland, jOregon 9722/ 

Phone: (S03) 249-2000 ■ ' 
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ST. LOUIS 



V 



St. Louis uses standardized achievement tests published hy a commercial 
teltin'g service and a state-designed minimum competency test. The district is in 
the process' of developing its own competency criteria to be administered in grades 3, 
5, 8 and 10. ^ 

PURPOSES' OF TESTING , . 

NRTs are used at the elementary ?nd secondary levels for: 

• program evaluation ... • . 

• placement of stude^its in- remedial classes. ' 

• measurement of district wide achievement progress. 

At the secondary- 1 eV'el NRTs were used for placement of students in skills 
focused courses. However, si/ice the introduction of the C.A.T., this use has been 
suspended on a systemwide ba$is pending results of the- equating .tests . Test results 
are also used in the evaluation of federal programs, 

There is currently no coverall systematic effort to relate results of 
student assessment to the curricul um\al though individual schools can. use the infor- 
mation to formulate school plans. To\some extents test content influences the cur- 
riculum. ' ' \ ■ 

SELECTION OF TESTS ^ \ ■ - , 



ment 



The Deputy Superintendent of Instr^uction selected the California Achieve- 
Tests (C.A.T.) for use in gradesj K-12. \ 



TE CHNICAL I;NFORMATrON \ 

— ! . \ 

As the district is still inithe process\of developing its own performance 
standards, reliabilify and validity of assessment criteria have not yet been deter- 
mined.' In order to preclude cultural,, racial or gender bias, people of both sexes and 
major races are involved in defining the sta-ndards. 



ADMINIS TRATION OF TESTS 

^> 

All students in all schools 
testing is conducted in the students' 



t grade 
chopls. 



1 evels 



Tests are shipped to designated 
responsible for recei^pt, distribution and 
test booklets- shipped and returned. 'Last 
not returned. The BEST tests are counted 
returned. A new test is used eac.h year. 



test coordinators 
return. Tally is 
year less tban 40 
upon receipt from 




Ire tested. AU 



in\each school who are 
kepV of the number of 
out of 50,000 tests , were 
'the st\te and then 



testing 



Test, coordinators receive in-service training and instructior 
procedure. Thfey then conduct in-service, training for faculty. 

•Special education students are exempt from C.A.T.' tests but do taKe the 
""Metropolitan Instructional s . When administered, tests are given to handicapped 

'\ ■ • • \ 
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students primarily as "power tests**, --that is time restrictions are eliminated 
and i^ndividual adaptations are made. The district has reTatively few 1 imi ted 
Enali'sh proficient students and they are not presently tested. 



MANAGEMENT OF TEST DATA 7 

The-district has one data . basg^ra:ad., one of the subsystems contains test 
results^ lability and achievement by student. The district generates class l/ists, 
objective! summaries by the publisher's designe^.ted categories, administrator's 
-summaries, frequency distributions and all summary statistics for each C.A.T, 
pre-post test results by student, grade, school and special program. The data base 
also allows for analyses by gender and race although these are not currently 
conducted. , * . , 

Each school- receives the results for its strdents, for the subdistrict - 
and" city a-s* a whole but not for other schools on the C.A.T.- The BEST report 
sent to each school lists results for all sofhool An Administrator's Report is 
sent to principals and the Board of Educati/On ana central office receives Achieve- 
ment Summar^y Reports. Evaluation Report? .which show achievement across projects 
are sent to board members, central administrators and appropriate persons in each' 
project. 

" . . In-service training on test result interpretation for the C.A.T was 
given to principals and test coordinators last year. In addition!, 80 schools were 
visited and a newsletter and supplementary interpretative memoranda on, how to .read 
'test results were/are published. 

Parents' receive an individual test record which contains an explanation 
of results. They mayialso receive assistance from schools and during parent- 
teacher conferences.. — frs^essment staff have also attended PTA meetings. A bro- 
chure is currently being prepared for parents. ■ ' 

Student records bontain a label which shows the results for each test 
taken. Teachers, school administrators, and nurse-S'ocial workers have access to 
the records as do parents upon request. 

.The district has maintained a profile by subtest in terms of system 
scores as. well as. by student for at least ten years. ■ 

The research department (Division of Evaluation) is in the Instruction 
Department. The Assessment Center in the Division of Evaluation is responsible 
for test^aldministration, - 

TEST RESULTS y 

There are no system-wide programs to pre'pare students for tests. 
However, some efforts have been made at individual schools which have purchased 
materials to increase scores. This practice is discouraged by the Assessment 
Center b.ecause it defeats the purpose of testing. 

The standards for passing minimum competency tests were set by the 
state. The standard Is based on materials which should have been presented to 
students by the 6th or 7th grade. Thfe' test contains 13 objectives per subtest and 

three items per objective. Students must respond correctly to 75% of the items on 

■ ■ ■ / ■, ' ■ 
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ACHIEVEMENT TESTS (ST. LOUIS) 





Tested 


name or 
' Test 


ueslgned 

by Whom / 


Areas 
Tested 


Metric 
or UM* 


When 
Given 


NRT/ 
CRT 


Forms 
Used 


Norms 
Used 


General Purpose 



Pre-K 



K-12 



Cooperative 

Pre-School 

Inventory 



Cal i fornia 

Achievement 

Test 



Addi son 
Wesley 



CTB McGrawf 
Hill 



BEST 



State 



3, 5, Performance 
8, 10 Standards 



District 



Reading readi- 
ness, Math con- 
cepts, fine 
motor coordi- 
nation 

Entire Battery 



Percentile "~;rall NRT 
NCE rela- Spring 
tive to 
age norms 



Scaled Oct NRT 

score, Apr . 
grade equiva- 
lent, NCE 
individual 
percentiles 



Reading/Language, Percent 
Matli^, Government/ correct. 
Economics plus objectives 
10 local objec- passed 
ti ves we^e state 
designated* but 
the district 
developed its 
own measures 



Math computation 
and large list 
of objectives 



MINIMUM COMPETENCY 
March CRT 



Form C, 
:ystemwide , 
Form D fpr 
Title I 
makeups 



New each 
year 



Age Norms 



National 



In development 
to be implemented' 
next year 



To determine readiness for Kin- 
dergarten; to screen for Title I 
Kindergarten extended Day Program 



To monitor achievement, program 
evaluation. Title I assessment 



State minimum competency test to 
determine the extent to which 8th 
graders have met certain skills 
design a tod by the state as minimum 
competency. The test is first ad- 
ministered in grade 8 but students 
continue to take sections not 
passed until they graduate. The 
test, however, is hot a graduation 
requirement. 

Concern wi th "students moving 
through school without acquiring 
basic skills 
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each subtest and to at least one item per objective in order io pass. Twenty-fiye 
^to thirty percent of all 8th graders pass all state and local objectives the first 
time tested: ,Sin'ce the test will only be administered; for the 4th year in 1982, 
there is no summary report on the cumulative pass rate for" a cohort. 

There is no systematic remedial plan for students who fail th;e BEST or 
score low on ,the C.A.T. Remedial assistance is available in the regular Plass- • 
room, in before/after school drop-in programs, in individual schools and in sk-ills 
labs . 

Test scores may be taken into consideration in promotion decisions but - 
they are not used as standards. Individual tea.cher judgement is the primary cri- 
terion. Students are not required to pass the BEST to graduate. . / 

Legislative measures 'avej been proposed which would specify minimum 
achievement levels for studen.ts out! none have passed. 

The state pays all costs tor the BEST except for the answer shefets. 
The district requested . pre-sl ugged answer sheets which the state did not /provide. 

/ 

For further information on the St. Louis student assessment program, 



contact; 



Jerry Powers or Robert Loveridge 
Research and Evaluation 
St. Louis Pu-blic Schools 
911 Locust Street 
St. Louis, MO 63101 

Phone: (314) 231-3720 




;/ SAN FRANCISCO ^ • 

The district uses standardized achievement tests published by a com- 
mercial testing service and district designed minimum competency tests. 

PURPOSES OF TESTING V 

NRTs are used at el ementary 'and ''secondary levels for: 

• program evaluation 

I placement of students ^ ... 

• diagnosis of individual student strengths/weaknesses ^ 

• and to place place- students in remedial classes 

• to measure district-wide achievement progress 

• to assess the need for curriculum revision 

• to determine the need for teacher in-service training 

At the elementary and secondary level, CRTs are used: ' 

I to place students in remedial classe,s 

I to promote students from one grade ^1:0 another 

I to determine the need for teacher in-service training [ 



The results are also used in the evaluation of federal prograjns, 



CRTs are referenced against the curriculum^ A review! of item analyses is 
conducted by'^th.e Curriculum department. If specific groups of students or students 
district-wide are consistently missing certain items ^ they are re-written. Curricu- 
lum personnel also go into individual schools which show weak test resul^ts in spe- 
cific areas to work on strengthening instruction and curriculum; in those areas. 

SELECTION OF TESTS 



When tests are to be selected, special committees are appointed with 
representation from teachers, and program evaluation, administration and curriculum 
offices. The district has no pre-set criteria for test selection. Major publishers 
are invited to present tests for consideration by the selection committee. 

When the district designs its own tests, subject area teachers work with the 
curriculum pffice to develop test items. This .is done annually for the competency 
tests. ^ . • 

TECHNICAL INFORMATION • , ' • 

Evidence for reliability of district designed tests is provided through 
the^' maintenance of item analysis data. To assure validity, teachers f-eview all test 
"Questions and muTtlple items are used to test specific skills. Item analyses of >, 
response^ by sex and racial/'ethnic groups are conducted to assure that test items" are' 
not biased. ' • / 
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ADMINISTRATION OF TESTS 



students' 



With a few exceptions, all students tnalT schools are tested in the 
schools. Test security is the responisibil ity of school principals. 



•In-service training on test procedure! for teachers is conducted as 
a joint project by the curriculum office and the Special Funded Projects offjce'. 
Consultants from CTB McGraw-Hil 1 are brought injto discuss procedure for^..the 
CTBS. 

Non-English speaki ng -and some speciaV-^ducation students are exempt 
from tests. Special education students are tested according to their Individual 
Education Plan. Tests in Chinese, Vietnamese, Snanish and Tagalog are being 
developed. State law requires that the Proficiency Test be taken and passed, in 
English.*' However, students unable to take the te^t because of physical or m'ental 
limitations are' tested in other ways. 

MANAGEMENT OF TEST DATA 

The test data base and student data baseiare separate.- The test'/data 
base has information in terms of students in specific schools at a specific time. 
Test scores for an individual student over a periodlof years cannot be accessed. 
The student data, base shows only the latest test scores. Each new- entry automa- 
tically deletes the previous entry. The district is\ wor-king to change this 
system. . 

The test data base^generates a number of analyses and reports for the 
CTBS which are issued to teachers, counselors and administrators. These include; 



- student scores distribution /' 

- response analysis by groups 

- test summary reports 

- student scores by counselor 
student scores and items missed by teacher^ by school, by student 
, name 

- district report by schools 

- discrimination index and item summaries by jspecial education, L,ES and 
NES groups 

item summaries by school 

ethnic and sex breakdown of students' scored by school and grade 
The competency test results are maintained by student arlid percent items correct 



Analyses can only be conducted by school and grade leve 
1 angua'ge or SES. 



but not gender, race. 



Teachers receive assistance on 
in-s*ervice training. Parents receive an individual test 
which describes the Proficiency Test,^ explains i ts-purpo|se, 
must do to pass . ^ i - 



test result intjerpretation during 

record and. a brochure 
and what students 



..A l^^ass/fail notation is made on the student cumulative record with 
regard to the Profici^gncy^^JTest . Both cumulative and EDP-records are accessible to 
teachers, counselors and parents. Test data are maintained indefinitely. 
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ACIIIEVCMENT TFSTS (SAN FRANCfSCO) 


I*" 






\. ■' 


♦ 




_Tp>ted 


IIUIIlC? \}T 

Test 


by Whom • Tested 


necr ic 
or UM* 


When 
Given 


CRT 


Forms 
Used. 


Horns 
Used 




GpMpmT Piirnncoc • 






K 


Metropolitan 
; Readiness 


Psych Corp Readiness 


Percentile 
Rank 


Oct 


NRT > 


P/I 


National 


1. 


Ranking of schools for funding 
elitjibility : 






1 


CTDS . ' 
II , , 


CTB McGraw- Reading,, Language, 
Matherfiatics 

• 


G F of Mpan 
SS 


Or t 

April 


NRT , 


S/A,B 


National 


2. 
3. 


Identify program participants 
Progranr^va+iia 1 1 on 






3: 
4 

5 ' • 


" 1 

M 
M 


H 
II 
II 


II 
II 

M 
It 


II 

II 
II 

tl - 


II 

M 
• H 
II 


II . 

/" 
M 

II \>^^^ 


S/C 

S/1 ' 
It 

xS/2 


II 

II 

M 
II 


4. 
5. 


Instructional in'formatVort 
Student .programming 


• 




6 


. M ' 


II 


It 1 - . 


ii 


tl 


II 


II 


i II 










.7 


tl 


II 


II 




II 


M 


S/3 


II 






r 




8 


M t 


11 


II 


ii 


II 


II 


II 


M 










9 


II 


''II 


M 

/ 


M 


II 


II 


S/4 


If 






i 




^ 10 


II 


II 


II 


II 


M 


M " 


II 


II 










n 


II / 


II 


II 


M 


- M 


il " 


tl 


II 










^ 12 

. / 


CTBS 


CTB/McGraw- Reading, Language 
mil Mathematics 


G.E. 6f 

Mean SS 


Oct 
Apr 


NRT 


S/4 


II 










\ 








\ 

■ ; \ 
I ' '1 
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\ MINIMUM COMPETENCY TESTS (SAN FRANCISCO) 



Name of 
» Test 



Minimum Stan- 
dards Test 



UcslgiiaJv 
by Wiiotii 



District 



A^<^^^» 
Tosled 



Metric 
or UM* 



When 
Given 



Reading Percent January 

Writing correct May 

Mathematics 



NRT/ 
CRT 



CRT 



Forms 
Used 



A R B 



Norms 
Used • 



General Purposes 



Minimum basic skills needed ' 
for firomotion 



Proficiency 
Test 



Dec 
Mar 



Minimum proficiencies needed, 
for graduation (pass each 
subject any time durinq grades 
9-12) 



Proficiency 
Tes:t 

Proficiency 
Test 

Proficiency 
Test ■ 



District 



Reading 
Writing 
Mathematics 



Percent 
correct 



Dec 
Mar 



Minimum. prof iciencies needed 
for graduation 



133 



T 



The district does . not have a research department. The curriculum 
department is in charge of test administration* 

TEST RESULTS "t, 

The standards, for pass-fng rpinimum competency tests were established by 
consensus of teachers, parents and administrators. Seventy percent of the items 
on the Proficiency Test must be answered correctly for a student to. pass. 

. \ 

If sVudents fail subject areas^of the Proficiency Jest , they attend 
mandatory remedial classes.' (paid for by' the state, .district and community) i,n. 
addition to regular course worl^. Students who fail also have access to a computer 
printou,t that- shows their areas of ^weakness. Students must only retake those 
portions of the Proficiency Test they failed, and have repeated opportifni ti;es 
to do so through the 12th grade. The pass rate for the district for all grades 
tested is approximately 95%. , 'V 

Remedial assistance is also available in the regular classroom, in 
before/after school drop-in pr^ograms, in summer school , through tutorial assis- 
tance, in skiVls labs and through home study as a result of parent/teacher con- 
ferences. ' ^^^^^^^ - 

In addition to test scores , administrative afid teacher decisions are 
factors in promotion decisions and teacher ■ judgement is a factor in decisions to 
place a student for remedial ,work. Students must pass the Proficiency Test to 
^raduate^even if all other >equirements have been satisfied. State law precludes 
t^e issuance of special diplomas to those who do not ever'pa'ss the test. 

.i^ The district pays /the total cost of the student, assessment program 

exeept for summer school which is paid for by State of California. 
'.•>•«■■■ * - - 

" . ■■■/.■ 
For further information on the San Francisco student asseissment program, 

contact: 

Earl Blanchard 
\ Parkside Curriculum Center 

. ■ , 2550, 25th Avenue 

. . San FranciSttJ, CA' 94116 

■ Phone: (415) 555-9599 ' ■ " 
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• ,^ ■ SEATTLE A . ■ 

•Seattle uses standardi zed tests published by a commercial] testing 
service. and district designed minimum competency tests. 

PURPOSE OF TESTING / • . / ■ • 

Norm referenced tests are used at both el ementary ^and secondary levels:- 

• for program evaluatipfi 

^— ,1 for student dij_gao5A5:^ :" -^^^^ 

. for curricxTTum revision 

I to measure district-wide achievement' progress. 

■ i \ > ' 

Criterion referenced minimum competency tests are used at elementary and secondary 
levels for student diagnosis and at the secondary level for ^curricul um revision-and 
to measure district-wide achievement progress. The results are also used in the eval 
uation of Title I (ESE/^), and Title VI bilingual programs.' 

^ NRTs are referenced against the curricul um ' to the extent possible and ' 
CRTs are district developed to curriculum objectives.^. Test'results are fed back 
to curriculum specialists who make ap'propriate revisions. . • 

SELECTION OF -TESTS ; ' . , 

Fhti "district Test Committee comprised of teachers., principals, coun- ^ 

selors, pupil personnel office representatives, curriculum specialists, testing 
'and evaluation personnel, special education and data processing personnel is 
responsible for sel-ecting tests. The committee is also broken down into sub- 
committees which are instructed to invite in curriculum 'special ists and other 
persons with expertise tp assist in the. review. /' 

" ' ■ A\ ■ . . 

Major publishers are asked to mail in specimens and. give presentations 
to the committee. Cost is. not a prime,, criterion and no competitive bids are 
received. The committee does * have questionnaires to guide them, but these 
vary .depending "on the purpose of the test. 

The district does not presently use an item bank. However, in future, 
when developing objective reference ,te?ts, the district will consider various 
sources including the Northwest Evaluation Association which has received input 
from various districts including Seattle, In the past teacher committees de- 
veloped items from test objectives.' ! • 

TECHNICAL INFORMATION ' ; 

Reliability on the district-designed minimum competency Performance 
Test has- been demonstrated with an internal consiste/icy measure (.95) and a test- 
retest measure (.80 to .85).* 

The competency tests have both curriculum and content validity. Jtems 
were matched to/skills taught in the clas^sroom and reviewed by teachers as well 
as a panel of citizens to determine if theXitems matched necessary life skills. 

" ■ ■■ \ ' 
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To preclude cultural, racial and gender bias, a committee comprised of 
men and wonien from various ethnic groups reviews each test item. Itern ratings. are > 
conducted on an individual basis. . A summary is drawn up, the items are discussed 
and any necessary changes made by the Testing Office. The changes .are then re-^ 
viewed by^the Commi'ttee using the same process. Item analysis of tests using •• 
group comparisons are then conducted. Finally, ahe Sex-Ethnie Bjas Committee 
whose basi'c job is to review textbooks also reviews all NRTs and CRTs. 

ADMINISTRATION OF TESTS ^ ' . 

-: ^ - All , students in all schools at the designated grade levels are tested 

with the C.A.T. and the minimum competencies tests and all testing. is conducted within 
the students' schools. The minimum competencies Performance Tests, which are numbered 
sequentially, are stored at the Testing Office. When sent to the schools, they become 
tjie responsibility of the Building Test Coordinators who must assure their security 
and return) to the Testing Office. NRTs are* stored in schools. 

^j^^ Building Test Coordinators who "are designated by school principals., and 
are'^general ly elementary school principals or high school counselors, are responsible 
for in-service training of faculty members each time a new test is introduced.. • \ 

Exemption of Special Education students from tests depends on the judgment \ 
of the teacher'. Exemption of limited English proficient students is a. function of 
oral proficiency' test scores.^ Braille and large print tests are available for the 
vision-impaired. Tests- have been taped for orthopedical ly handicapped. ' 

MANAGEMENT OF TEST DATA . ' ^ ^ / 

The district' maintains a centralized test history fil e „by student and 
school. The data base contains fhe.test number, test level, norms and type. The 
student di|.;^a base is independent but can merged with the test data base us,ing 
'■g-tudent I':'D.. numbers. The system utilizes, a table-driven program which produces per- 
centiles and Stanines from raw scores. The system design is open which permits pro- 
duction of other analysis frorn^ raw scores using another set of tables. The data base 
allows for special analyses by^^chool , gender and race. , 

Internal/reports with Item analyses are sent to principals and curriculum 
specialists. In addition^ principal s , curriculum and ins'tructional personnel receive 
school level reports detailing all subtests and summary data. 'A public report showing 
•total reading and math^by^ Stanine^is issued to the Board of ^Education . 

Teachers receive assistance on interpreting test res\jlts through j'n-service 
training by Building Test Coordinators and written memoranda.' A special form for 
individual students showing percentiles and Stanines with an explanation of test - 
results- and meaning including graphs is prepared'for parents. These forms are given 
to parents dyring parent-teacher conferences to teachers .can assist in interpretation. 

. Each student's cumul ative record sKows eaah subtest /taken with percentile 
arid Stanine. Principals, counselors, evaluation and testing /personnel , parents and 
students have access ^to the records. ^ / 
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- ACHIEVEMENT TESTS (SEATTLE) 



.lirade 
^Tested 



Name uT 
Test 



K 



11 



hmsamn-iwMi 



Designed 
_by Whom 



Areas 
Tested 




Metropolitan , 
Readiness Test 

California 
^AchlevemehJ: 



HBJ Psych 
Corp 



Reading, number 
readiness general 



CTB McGraw- Reading, Math, 
Hill Language 



iUJiorril^ CTB McGraw- Read lig ; Ma th 



Achievement ^. 
Test \ P. .* 



Hill 



California • 
Achievement 
Test 
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Language 



Metric 
or UM* 



CTB McGraw- Reading, Math, 
Hill Language 



Stanlnes 



Percentile 
Stanlnes 



Percentile 
Stanlnes 



WfierT 
Given 



May 
May 



Oct & 
May 
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NRTA 
CRT 



NRT 
NRT 

NRT 



Percentile Oct & . NRT 
Stanlnes May 



Tall 



Forms 
Used 



^Norms' 
Used 



General ^^ur pose^ 



Part of early Kindergarten screening 
program 



Level 11 National JILle I screening 



Form C 



Level 12 
Form C 



Level 13 
, Forms C 
(Fall); 
D (Spring) 

Level H 
Forms C 
(Fait); 

D (Spring) 

Level 15 
Forms C 
(Fall); 

D (Sprjng) 

Level le 
Forms, C . 
(Fa^ll); 

D (^prlng) 

Level 17 
(Forms CAD 
as above) 

Level 18 
Forms C &- 
D 

Level 19 
Form C 



National 



National 



A 



Program Evaluation, Diagnosis of 
Indlvdual jstudent s^t/engths/weak- 
nesses. To assess need for cur- 
riculum revision. 



To measure\d1strlct wide achieve- 
ment progress ^ 



To report td parents^ federal pro- 
gram evaluation * 



To report to/parents, federal pro- ^ 
gram evaluation 



To report ♦lo parents, federal pro- 
gram evaluation 
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HINfMUM COMPETENCY TEST (SEATTLE) 



urade '^""•''iranie of 
Tested Test 



Designed 
by Whom 



Areas Metric 

Tested or 'UM* Given CRT 



Khen Ml/ Foniis ~ Norms 
Used Used 



3 *Miainmin Competeogy District Brief writing & Raw Score Spring CRT Three 

Screening Test Language test . forms 

^ ^ : ~ developed 

6 *Mininmm Compe- District English, Reading Raw Score Spring CRT Three 

tency Screening Math ' fornis 

Test , ^ . developed 

7 Will probably be eliminated because of high correlation of results with C.A.T. scores 



General Purposes 



Screening for remediation on an 
individual basis 



Screening for remediation on an 
individual ba$is 



9 Minimum Competency 

Performance Test District Life Skills Raw Score Fall CRT Three 

^ / . / • ' . forms 

I developed 



To Minimum Competency District Life Skills 
Performance Test 



Raw Score Fall CRT Three 

forms 
developed 



11 Retakes of Minimum Competency Performance Test? for those who did not pass and new students. 



^Presently for reii iiation as above, 
origina^lly intended to be used as 
graduation requirement but decision 
has been delayed 

Presently for remediation as above, 
originally intended to be used as 
graduation requirement but decision 
has been delayed^ 
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The individual student history file^ is maintained ijjdefi.nitely . School 
level results can be recreated from this ■filq'-.upon request. .." 

The Testing and Research offices aj;^e within the Division of Evaluative 
cov»>,-i^o^ ^r,A ^ ^ 4._ X /^ .... T..^ .. 1^.. manager of Testing 

n. 



land 


-Technical 


. TES^ 


■ RESULTS 








The district '.is presently in- the process /Df field testing the Random 
House program "Scoring High on the C.A.T." for" Use as^test .preparation . 

1 \ . ■ _ • , 

A coirlbination of parent and teacher cbmmittees was responsible for 
determining the^standards for passing minimum competency tests. Test items were 
examined to determine validfty and the test was ' piloted without' a cutoff. The 
cutoff was then <set at different levels to determine rej iafc)illty on a test- 
retest basis,. The final cutoff was set at 80% of test items correct and" relia- 
bility proved positive on sebpnd and third field tests. Roughly, 60% of students 
who took the te^t at 9th anM'pth grade level passed but the final figure is 
pending retakes. • , " . ' 

If passing the test becomes a graduation requirement, a remedial course 
win probably be mandatory for those who have not passed the test by the second 
semester of 12th grade. 

^ Remedial work primarily takes the form of assistance in regular class- 

rooms at the present time. In addition, learning packages for students to take 
home arebejng developed. 

T 

Fjresently, test scores are not ta'ken into account when deciding to 
promote, graduate or place a student for remedial work. Neither the state nor 
the district presently specifies minimum achievement levels. Benchmarks and 
objectives are under discussion but have not yet been introduced into the legis- 
1 ative process . y ^ . ' 

Because thb .state h^s a required Fall testing prd|ram 4th graders, 
they pay for the 4tn grade C.A.T. All other costs are \aid by the 'district. 



For further. information on the Seattle testing ^program, please contact: 

David Hoffman ' . 

Manager, Testing and Technical Services 
Seattle School District No. 1 
815 Fourth Avenue N. % 

Seattle, Washington -98109^ . / 

Phone: (206) 587-4220 . 
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TOLEDO 

The district currently uses only standardized achievement tests published 
by a commercial testing service. The state, however, has mandated a minimum compe- 
tency-test which must be in place by Sept-ember of-1983. The test, .which _is in; the 
early stages of development, will probably ;entail a district-designed or a custom- 
designed test from a major publisher. The district will de,termine content areas to 
be teste^, grades to be tested, cutoff scores, and whether or not the test will be a' 
graduati'bn requirement, ^ ^ . ^ 

PURPOSES OF TESTING ' ' • - \ 



The 'district's NRT.'s are used at the elementary and secondary levels: 

^^^^^^^^ / . 

% for program evaluation 

• for placement of ^students . 

I to place students in remedial classes . 

• to assess the need for curriculum revision 
•to measure^ district-wide* achievement progress 

I 'to determine the. need for teacher in-service training 



The results are also used in the evaluation of federal programs. 

The tests -are referenced agatnst the curriculum in' reading and math and 
the district is working to- match the tests to the curriculum in other areas. Item 
analyses from tests are utilized to determine areas of weakness in the curriculum, 

\ . . ' ^ 

SELECTION OF TESTS' V ■ ■ .... • , . 

The dris'trict has a standing Test Ayv-isory eommittee which consists of 
adn>inistrative personnel and representatives \from the ' P. T. A. and the teachers' 
union (AFT). The district has nc specific policy., for dealing with test publishers 
nor .does* it have pre'set criteria for selecting tests. - •■ . 

# • ■ ' .- ■ . • 

ADMINISTRATION OF TESTS 

>:The I.T.B.S. and T.A.-P. are administered, to all students in all schools. 
.All testi.rjg is conducted in the students'/schools. Test^-security is minimal; 
attempts are made to keep the tests under fock and key. Voluntary, paid in-service 
training on testing, procedure was c&nducted the^^iiVst. year 'the tests j?^e-re adminis- 
tered.: ' V - " . ;\ . ' "^"^ 



^Speci^al education students and' those |tucfe^nts whose home language-is not 
English are ex-empt. from -fhe district's ac>hteveni|i^^ and large-print 

versions are provided for vision-impaired stikte^ilsv tesjts are administered orally 
to orthoped»icall)( handicapped students by aides^KjYO determination. " 
visions has yet been made with regard to the minraum^compqtgncy 
being developed. - A 

\. ■ 

MANAGEMENT OF TEST DArTA . — ' . 



'Of special pro- 
tests which are. ^ 



The district. -has maintained a test file by individual 
'summary data since 1970. The student data base is separate' and 




student and 
contains no 



scho? 
test 
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information. Longitudinal test data from' individual students must be accessed by 
consecutive tapes. ^ However , the 'computer does generate a label showing the full 
flange of scores reported which is placed on student cumulative records. Principals,- 
^teachers, counselors and parents have a-ccess^ to these records. 

The district generates a pre-post growth graph by student and grade leve\- 
for the achievement tests-r -The test data base also produces .alphabetic student list 
reports, ranking reports by gra.de level within buildings,, gro'up item analysis re- 
ports, and buiTding summary reports with summary statistics ';by^.£rad^^^^ The 
data base allows only for analyses/ by schoxd^-aad geader but hi^4^.ai:eV^^^^^ . 
SES. ^ / 

- • ' / ■ . ' . . ■ 

In addition to the alphabetic'\li st reports for teachers and building 
summary reports for pf i n^el'pal s , a system summary report' is produced for curriculum . 
^personnel, research pe/sjnnel and .the Superintendent. A special presentation is 
made to the Board of^Ed'uC^tipn. . ^ 

' , Paid in-service training on test result interpretation was conducted for. 
teachers when the 'I .T.B.S. was' introduced. Parents receive test reports which show 
student grade equivalents and percentiles. A percentile,.profiTe is graphed out . on 
the report. Parents of elementary students receive the reports just prior to con-, 
ferences so that they may ask questions. High school students parents may request 
conferences . ^ ' ' 

There 'is a great deal, of interaction between the research department and 
curriculum angl instruction. | Tlie district is'involved in team management so problems . 
•arq, handled by^teams^ wi th ".pertinent repres^entati ves from the district. The distr^ict'^ 

has a Testisg Coordinator 'who is in charge of test administration... \ . 

•» • ■ *■ ' . 

TEST RESULTS ■ • j ' ' V- " 

The district has no specific pol.icy for hand! i ng, students who fall below 
minimally acceptable levels , on the I.T.B.S. or T.A.P. Scores are used for place- 
ment of students' if the building has remedial classes but such placement is not 
automatic. Remedial assistance occurs in the regular classroom sometimes, may also 
be available in summer school or skills labs. Most remedial work is. state and 
fe'derally, supported. 

In addi'tio/i to a.chievement test scores, grades, and teacher and principal, 
junior and senior -high counselor recommenda'tions are taken into consi disration in 
promotion and, .placement deci.sions-: — . " - 

/'CurrentJ^y'T' no mi.nimum achievement levels have been specified and no legis- 
lati^te'measjj^iesrof this nature have been 'prop,osed. The distri ct. pays the entire 
''cost of tKe student assessment program. ' ... 

^ For further information on Toledo's testing program, contact: , 
V- ^J^^^'^Sally Clapp - ' 

Toledo Public Schools ' 
Manhattan Boulevard and ETm Street 
Toledo, -OH 43508' 
. Phone: (419) 729-8411 . ' 
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brade 
' Tested 



1 



3 
4 
5 
6 

7 
8 
10 

11 



•ACHIEVEMENT TESTS (TOLEDO) 



Nain« of 
Test 



Designed 
by Whom 



'Areas 
Tested 



Iowa TBst 
of Basic 
Skills 



Iowa Test 
of Basic 
Skills 



Tests of 
Achievement 
and Profi- 
ciency 



Riverside 
Publishing 



Riverside 
Publishing 



Reading, Math— 
alii grades; 
grlades 4, 6r 
and 8, Language 
siibtests and 
^?ork study sub- 
tests 



Reading, Math, 
Written Expres-^ 
sion, Work Study 
Skills 



Metric 
or UM* 



When 
Given 



Standard 
scores, ' 
percen- 
tiles 

Normal 
curve 
equiva- 
lent 
Stanine 



April 



April 



April 



Early 
Nov 



NRT/ 
CRT 



NRT 



NRT 

NRT 
"NRT 
NRT 
NRT 



NRT 



Forms 
Used 



Norms 
Used 



General Purpose s 



Form 7 



National 
Nonns 



From first sheet 




Form T 



National 
Norms 



From first sheet 
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WASHINGTON,, D.C. 



. The district uses both norm-referenced^^hi evement tests .publ ish^d by commer- 
cial testing services and district-designed critef^on referenced tests. The district's 
criterion referenced testing program was in the. process of revision and new, development 
during the. school year 1980-81. The tests are being pilx)ted during 1981-82 and. wil 1 ' 

be fully implemented when the pilot process is finalized. 

■ ■ . • ■ . ' ■ 

PURPOSES OF TESTING , 

NRTs are used at both elementary and secondary 1 evel s : ' ' ' 

• for program evaluation - • - v 
to measure district-wide achievement progress 

CRTs are used at the elementary level ■ 

• for program evaluation ^; . ^ 

• diagnosis of individual student strengths/weaknesses 
• . • to assess the need for curriculum revision' . 

The results are also used- in the evaluation of federal programs. 

• ■ ■ / ■ rc'^- . : 
The district's curriculum has been revised to strengthen weak areas which had. 
"been determined by test data jFfom past CRTs. The curriculum developers are key staff 
in Bevejl oping test items which, reflect course objectives. More and.more efforts are 
being ma^e^.to touch base and strengthen contact with school principals to assure their 
understanding of the use of CRT test score information and the relationship to everyday 
instruction., Principals also receive an annual NRT report and are expected to work on 
grade level and \peci fic, cl assroom levels to modify instruction 'as required. 

SELECTION OF TESTS ' 

Although the district has no standing test review committee, the ad hoc com- 
mittee is- formed when it is necessary to select or review tests consists of . the Director 
of Pupil. AppraisaT, Curriculum Supervisors, the Director Q.f^Counseling, the Assistant 
for Research and. the Assistant ^or Evaluation. Ad hoc meniibers would be classroom tea- 
chers an'd counselors , principals /and representatives from the regions. 

Since the district has used its present NRTs for a decade, it currently has 
neither specific policy for dealing with publ ishers nor pre-seit criteria for test 
selection." ."However , when the district developed its own CRTs, it sent out RFPs to tpst 
publishers outlining the district's objectives in designing the tests. Interested 
publishers" made presentations to the committee. On the basis of the presentations and 
other factors (including projected costs and will ingness to negotiate fine points), the 
Southwest Regiojial Lab (SWRL), a non-pro'fit federally fundejl-'agency , was selected to 
work in conjunction with the district on the devi^lopment yr CRTs-, in science and lan- 
guage arts . " ' / . 

SWRL performed the technical work and submitted it to the district for accep- 
tance or rejection. The district supervised the item development process and retained, 
approval authority throughout. SWRL also assisted i.n developing in-house scoring capa- 
city to accompany the assessment program. The test items developed in the project 



belong to the district wherear, test items 
oped in ^Gon Junction with CTB-McGraw-Hi 1 1 , 

— TECHNICAL INFORMATION 



from earlier CRTs in reading 
have b^een. copyrighted by CTB 



and math, devel 



Teams .of teachers reviewed all test items prior to the formulation of the 
pilot test versions for expressions of sex-v ethnic, religious and cul turaT-^bias . 
Pilot studies of all CRTs are conducted to determine the quality and effectiveness of 
test items. Measures used are traditional item analysis statistics, inter-item corre- 
lations and percent of mastery/non-mastery . Bj36d on tn-ese analyses, items are either 
accepted, revised or discarded. 

ADMINISTRATION OF TESTS - 

^ ; ^A^k students in all schools^ are tested. Testing is conducted within the 
students', schools. The system^ s warehouse stores the tests, distrit^utes them to the 
schools^ and receives them back from the schools for scoring. Principals are responsi- 
ble for , the security of the test materials in the schools. /Training sessions, on test 
administratici^ and test score . interpretation is conducted by regional staff for test 
chairpersons ,\ho,.in turn, conduct training sessions for classroom teachers. 

\ ^ I 

Students in Special Education facilities, are exempt from tests. Special 

education student"^ who have been mainstreamed are tested with a notation in those. 

areas where" they can be tested. Tests can be administered orally to physically "vm- 

paired students and large print versions of ^both NRTs and CRTs are available for 

vision-impaired students. Students who have English as a second language, who 

take all or portions , of test^:, are tested with notation. 



can 



MANAGEMENT OF^ TEST DATA 



The test data base consists of a dat? summary for each test^>y individual- 
student as well as by classroom and school. ^ Each student*s I.D. number, grade and 
sex is coded so tbat. analyses can be done by gender as well as s^chool^birt; no 
language Or SES. The student data base is separate but can also^ be accessed by 
I.D. number. , * . 

On the CRTs, only the percent of students metering each objective is re-, 
ported. On the CTBS, an individual Summary showing-'^ch subtest score, 'percentile and 



grade equivalent Is generated 
also reported. 



The percent of .stud en per class taking a test is' 



Summaries by school and 'fop 
Pupil Appraisal Office. School l^v^ 
principals . 



the' district as a whole are provided to the 
data are given to regional superintendent^ and 



After each test^l'he Pupil Apprai sal Office cont|a.cts schoo.l tes.ting chair-' 
persons either directUi^^through workshops or through regional representatives- to 
provide assistance viHh test result interpretation. An emphasis, is placed on each 
t:est and attendanj^^ is required. Testing Chairpersons receive a special package, on 
test results tp^onduct workshops for faculty. As mentioned above, more contacts are 

lAng made wr£h school principals to assure their understanding of CRT test* score. 
1nrermati.CMi and the relationship to evepydayvinstruction . - 
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ACHIEVEflENT TESTS (WASHINGTON, DC) 



lirade ' 
Tested 



Name oT" 
Test 



Designed 
by Whom 



"^reas. 
Tested 



1-6 



Metropolitan 
Readiness Test 



Psych Corp 



3, 6 CTBS y 
9, & y 



CTB/McGraw- 
Hill 




Auditory Memory, 
Rhyming, Letter 
Recognition, 
Visual Matching, 
School Language/ 
Quantatlve Lan- 
guage 

Full Battery 



CBC-Diagnostic. 

Prescriptive 

Instrument 



C8C- 

Diagnostic 

Prescriptive 

Instrument 



District Designed Reading 

in conjunction , 

with CTB-McGraw- ' 
Hill (Copyright) 



District Designed 
in conjunction ' 
with ClB/McGraw- 
Hill (Copyright) 



\ 



Metric 
or UM* 



When 
Given 



Percentiles Oct 
Stanines 



Grade Equiv- 
alent percen- 
tiles 



. Percent 
of objec- 
tives 
mastered 
. Percent 
of students 
mastering 
objectives \ 



May* 



May 



. ^^Percent - 
of'objec- 
tive^ 
mastered 
Percent 
of students 
mastering 
objectives 



May 



liRTT 
CRT 



Fonns 
Used 



Nonns 
Used 



NRT 



Form P 



National 



NRT 



CRT 



Form S ; National 



CRT 



General Purposes 



To determine entry level of Kin- 
dergarten children and to provide 
teachers information for instruc- 
tional purposes. 



To measure district achievement 
progress and individual student 
achievement. To determine school's 
status relative to achievement. 

To -diagnose individual student 
strengths/weaknesses. To evaluate 
curriculum. 



To diagnose individual student 
strengths/weaknesses to evaluate 
curriculum 



(Cont»d) 
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Washington, DC Achieventeht Tests Cont'd^ 



Tested Test 



1-6 DCPS Wmpetcncy 
^ Based Assess- 
ments 



1-6 DCPS Competency 
Based Assess- 
ments 



ERIC 



2x0 



Oes jgjied 
W hom 



Areas , 
Tested 



Metric 
A or UM* 



When 
Given 



"mT 

CRT 



Fonns 
Used 



Norms 
Used 



General Purposes 



District 
Designed in 
Conjunction 
with South-, 
west 

Regional Lab 

District 
Designed In 
Conjunction 
/with South- 
west 

Regional Lab 



Language Arts 



Science 



Percent of 
stud en ts 
mastering 
objectives 



Percent of 
students 
mastering 
objectives 
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. ■ . Assistance with test score interpretation is provided to parents on the indi- 
vidual (Dupil reports. Testing chairpersons, regf^nal psychometricists, or Pupil Appraisal 
personnel periodical ly conduct workshops for parent groups. 

The date of test administration , student's grade equivalent and percentile 
rank are recorded on each student's record. Counselors,- teachers, parents, students 
and researchers (with permission from both school administration and- parents) have 
access to these records • ' " - 

The Research Division is separate from the division of Curriculum and 'Instruc- • 
tion. the Pupil Appraisal Branch, which is in charge- of the district student^assessment 
program, falls under' Curriculum and Instruction. 

TEST RESULTS ' _ . ' - . / , 

A te.st-taking program for the curriculum in reading, math, science and language 
arts has 'been developed by faculty in these areas-. Students are prepared on how to fake 
a test but not on test content. A handbook "Moving Up to Success in Test-Taking" devel- 
oped by the above faculty, has been given to teachers for use in grades 1-6. For grades 
7-12, a test-taking strand has been developed in the curriculum in English. 

Remedial work occurs in the regular classroom^ in summer schools and skills 
labs. Operation Rescue is a highly successful district remedial program which uses com- 
munity volunteers (college students, retired teachers and adubi-nistrators) to. work with 
students in specific weak skill areas. To assist students m\ CRTs, indi viduaT^ackages 
were developed for students to take home as a part of Operatlw^escue. 
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For further information about Washington's student assessment program, please 

Dr. Cynthia H,. Almeida .* / • ^ 

Director., ^ ^ 

Pupil Appraisal Office .... 

415 - 12th Street, NW 

Room 900 . • 

Washington, DC 20004 ; ^ ^* 

Phone7~T202r7^^^^^^^^^^^ 7- 
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